-- Logs begin at Fri 2022-09-16 02:54:16 UTC, end at Fri 2022-09-16 04:11:21 UTC. -- Sep 16 03:38:57.695794 dv-cinder-857993-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 03:38:57.705786 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 03:38:57 2022] *** Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: nodename: dv-cinder-857993-1-iscsi Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: machine: x86_64 Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: clock source: unix Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: pcre jit disabled Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: detected number of CPU cores: 4 Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: current working directory: / Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: detected binary path: /usr/bin/uwsgi-core Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: your processes number limit is 47680 Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: your memory page size is 4096 bytes Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: detected max file descriptor number: 2048 Sep 16 03:38:57.708340 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: lock engine: pthread robust mutexes Sep 16 03:38:57.709321 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: thunder lock: enabled Sep 16 03:38:57.709321 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 03:38:57.709321 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 03:38:57.747484 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: Python main interpreter initialized at 0x55c2e67499c0 Sep 16 03:38:57.747484 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: python threads support enabled Sep 16 03:38:57.747484 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: your server socket listen backlog is limited to 100 connections Sep 16 03:38:57.747484 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: your mercy for graceful operations on workers is 90 seconds Sep 16 03:38:57.747814 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 03:38:57.747890 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: *** Operational MODE: preforking *** Sep 16 03:38:57.748136 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: *** uWSGI is running in multiple interpreter mode *** Sep 16 03:38:57.748136 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: spawned uWSGI master process (pid: 112556) Sep 16 03:38:57.748322 dv-cinder-857993-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 16 03:38:57.755210 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: spawned uWSGI worker 1 (pid: 112557, cores: 1) Sep 16 03:38:57.755210 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: spawned uWSGI worker 2 (pid: 112558, cores: 1) Sep 16 03:38:57.755210 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 03:38:58.412738 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 03:38:58.413608 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 03:38:59.496937 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:38:59.496937 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: from cryptography.utils import int_from_bytes Sep 16 03:38:59.497619 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:38:59.497619 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: from cryptography.utils import int_from_bytes Sep 16 03:38:59.497619 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:38:59.497619 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: from cryptography.utils import int_from_bytes Sep 16 03:38:59.498094 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:38:59.498094 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: from cryptography.utils import int_from_bytes Sep 16 03:39:01.985118 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 03:39:01.985713 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 03:39:01.985921 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 03:39:01.986275 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 03:39:01.986358 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 03:39:01.986436 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 03:39:01.986677 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 03:39:01.986806 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 03:39:01.987094 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.987188 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 03:39:01.987426 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.987530 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 03:39:01.987752 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.987843 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.988075 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.988189 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.988416 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.988555 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.988732 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.988836 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.989062 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.989177 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.989372 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.989468 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.989693 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.989798 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.989952 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.990064 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.990272 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.990372 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.990576 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.990693 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857993-1-iscsi {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.990892 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.991023 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.991234 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857993-1-iscsi {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.991338 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.991552 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.991649 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.991856 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.991966 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.992165 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.992263 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.992481 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.992597 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.992787 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.992886 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.993110 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.993297 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.993411 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.994447 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.994569 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.994641 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.994714 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.994781 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.994845 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.995029 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.995121 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.995189 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.995410 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.995504 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.995728 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.995830 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.996054 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.996159 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.996360 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.996451 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.996682 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.996782 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.996994 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.997088 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.997392 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857993-1-iscsi {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.997496 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857993-1-iscsi {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.997712 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.997813 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.998022 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.998122 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.998337 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.998430 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.998750 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.998863 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.999093 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.999219 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.999398 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.999514 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.999719 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:01.999821 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.000044 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.000142 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.000345 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.000437 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.000671 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.000762 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.000990 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.001093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.001865 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.001988 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.002191 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.002285 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.002500 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.002591 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.002814 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.002940 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.003172 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.003266 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.003499 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.003598 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.003801 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.003899 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.004107 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.004198 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.004357 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.004455 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.004662 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.004761 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.004981 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.005088 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.005297 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.005451 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.005619 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.005799 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.005982 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.006117 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.006252 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.006396 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.006541 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.006677 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.006812 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.006980 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.007123 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.007271 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.007408 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.007552 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.007686 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.007827 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.007971 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.008107 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.008256 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.008397 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.008550 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.008826 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.008972 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.009130 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.009333 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.009472 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.009618 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.009760 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.009904 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.010038 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.010171 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.010303 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.010444 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.010577 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.010720 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.010855 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.011027 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.011164 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.011298 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.011441 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.011588 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.011735 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.011871 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.012013 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.012154 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.012296 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.012452 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.012596 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.012739 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.012880 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.013014 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.013161 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.013307 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.013440 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.013581 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.013722 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.013857 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.014024 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.014168 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.014345 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.014489 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.014756 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.014945 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.015179 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.015321 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.015593 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.015734 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.015869 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.016016 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.016158 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.016292 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.016425 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.016559 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.016691 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.016892 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.017538 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.017674 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.017829 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.017965 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.018100 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.018251 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.018387 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.018519 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.018660 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.018960 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.019114 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.019259 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.019474 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.019622 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.019765 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.019922 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.020058 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.020201 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.020336 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.020475 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.020618 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.020753 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.020895 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.021037 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.021172 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.021305 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.021438 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.021578 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.021731 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.021866 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.022000 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.022147 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.022283 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.022423 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.022573 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.022717 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.022853 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.023033 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.023170 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.023303 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.023436 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.023591 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.023727 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.023860 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.023993 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.024127 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.024269 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.024411 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.024545 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.024684 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.024818 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.024957 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.025104 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.025331 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.025495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.025632 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.025765 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.025899 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.026111 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.026248 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.026383 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.026522 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.026657 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.026790 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.026951 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.027103 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.027249 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.027383 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.027516 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.027661 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.027803 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.027945 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.028087 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.028222 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.028411 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.028586 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.028752 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.029022 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.029170 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.029315 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.029528 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.029683 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.029828 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.030013 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.030152 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.030314 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.030452 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.030622 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.030769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.031007 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.031159 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.031327 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.031512 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.031660 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:39:02.031803 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.031938 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.032071 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.032204 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.032346 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.032516 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.032653 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.032788 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.032928 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.032928 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.033209 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.033345 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.033485 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.033620 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.033753 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.033898 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.034033 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.034171 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.034319 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.034454 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.034587 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.034760 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.034902 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.035109 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.035278 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.035534 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.035695 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.035846 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.035982 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.036117 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.036250 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.036392 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.036539 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.036683 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.036818 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.036958 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.037111 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.037246 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.037474 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.037624 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.037782 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.037929 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.038070 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.038206 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.038351 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.038515 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.038651 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.038808 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.039146 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.039306 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.039504 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.039735 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.039907 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.040039 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.040169 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.040310 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.040457 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.040601 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.040736 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.040873 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.041004 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.041411 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.041550 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.041682 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.041812 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.041942 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.042070 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.042206 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.042361 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.042488 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.042628 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.042758 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.042929 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.043262 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.043406 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.043595 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.043687 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.043914 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.044009 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.044229 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.044319 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.044544 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.044641 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.044859 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.044947 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.045172 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.045262 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.045507 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.045602 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.045822 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.045910 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.046134 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.046222 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.046455 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.046541 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.046766 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.046871 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.047113 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.047425 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.047733 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.047988 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.048112 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.048421 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.048513 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.048734 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.048922 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.049058 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.049262 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.049432 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.049585 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.049674 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.049904 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.050033 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.050224 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.050359 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.050548 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.050674 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.050864 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.051017 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.051377 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.051526 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.051661 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.051784 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.051933 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.052058 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.052276 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.052406 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.052583 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.052706 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.052897 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.053021 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.053210 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.053335 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.053522 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.053654 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.053870 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.054002 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.054144 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.054278 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.054455 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.054577 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.054755 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.054880 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.055094 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.055219 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.055401 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.055542 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.056775 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.056930 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.056930 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.057179 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.057302 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.057424 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.057544 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.057675 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.057797 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.057920 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.058041 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.058202 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.058327 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.058461 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.058584 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.058716 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.058835 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.058970 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.059106 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.059239 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.059352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.059472 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.059593 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.059714 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.059843 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.059966 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.060087 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.060208 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.060337 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.060460 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.060595 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.060717 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.060717 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.060953 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.061081 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.061211 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.061342 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.061471 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.061593 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.061720 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.061841 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.061962 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.062092 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.062222 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.062474 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.062612 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.062735 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.062866 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.063004 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.063118 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.063307 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.063441 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.063603 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.064259 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.064468 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.064597 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.064775 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.064888 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.065104 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.065232 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.065416 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.065568 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.065704 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.065827 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.066014 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.066148 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.066320 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.066445 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.066665 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.066799 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.066999 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.067125 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.067349 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.067483 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.067662 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.067785 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.067976 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.068102 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.068288 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.068414 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.068608 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.068732 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.068918 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.069042 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.069231 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.069355 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.069540 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.069663 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.069851 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.069970 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.070161 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.070291 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.070480 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.070612 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.070782 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.070958 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.071132 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.071292 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.071434 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.071566 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.071788 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.071930 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.072060 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.072181 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.072363 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.072495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.072665 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.072793 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.073002 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.073142 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.073287 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.073416 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.073591 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.073712 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.073892 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.074022 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.074193 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.074323 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.074504 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.074635 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.074817 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.074962 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.075159 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.075294 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.075471 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.075598 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.075854 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.075989 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.076120 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.076243 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.076405 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.076534 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.076711 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.076837 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.077025 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.077152 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.077338 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.077507 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.077687 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.077818 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.077949 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.078070 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.078254 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.078385 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.078560 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.078689 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.078884 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.079058 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.079179 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.079352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.080099 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.080233 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.080409 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.080591 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.080725 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.080847 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.081039 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.081179 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.081326 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.081454 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.081631 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.081752 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.081936 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.082072 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.082234 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.082357 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.082535 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.082655 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.082876 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.083031 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.083163 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.083293 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.083481 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.083612 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.083742 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.083865 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.084053 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.084176 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.084359 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.084481 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.084689 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.084900 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.085025 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.085153 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.085276 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.085397 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.085562 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.085690 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.086003 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.086143 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.086266 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.086483 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.086626 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.086749 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.086877 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.087079 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.087205 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.087335 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.087458 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.087586 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.087708 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.087893 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.088016 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.088162 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.088317 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.088641 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.088768 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.088888 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.089134 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.089268 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.089391 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.089513 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.089667 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.089833 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.089978 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.090162 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.090302 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.090456 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.090605 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.090755 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.090929 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.091103 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.091266 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.091414 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.091542 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.091664 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.091793 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.091914 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.092035 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.092164 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.092285 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.092406 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.092535 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.092662 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.092789 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.092930 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.093126 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.093266 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.093401 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.093533 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.093711 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.093844 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.093997 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.094159 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.094380 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.094529 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.094701 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.094870 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.095109 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.095322 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.095462 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.095651 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.095781 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.095960 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.096178 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.096481 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.096950 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.097132 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.097258 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.097379 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.097499 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.097621 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.097752 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.097874 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.098001 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.098132 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.098266 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.098389 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.098533 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.098671 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.098859 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.099003 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.099192 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.099318 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.099499 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.099639 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.099862 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.100278 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.100395 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.100515 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.100635 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.100765 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.100888 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.101008 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.101155 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.101571 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.101708 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.101861 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.102309 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.102435 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.102583 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.103076 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.103212 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.103336 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.103456 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.103577 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.103697 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.103818 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.104015 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.104141 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.104263 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.104383 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.104511 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.104632 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.104766 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.104935 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.105356 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.105480 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.105600 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.106066 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.106217 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.106456 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.106584 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.106718 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.106718 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.106976 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.107102 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.107287 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.107287 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.107526 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.107648 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.107778 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.107901 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.108029 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.108181 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.108311 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.108703 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.109179 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.109353 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.109807 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.110000 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.110400 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.110514 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.110669 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.110792 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.110927 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.111078 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.111305 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.111442 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.111566 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.111687 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.111808 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.111929 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.112049 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.112178 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.112355 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.112780 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.112911 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.113040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.113169 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.113299 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.113430 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.113551 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.113671 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.113793 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.113931 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.114054 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.114175 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.114295 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.114712 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.114840 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115013 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115138 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115259 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115381 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115502 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115623 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115753 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115875 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.115996 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.116116 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.116235 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.116397 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.116682 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.116806 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.116934 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.117055 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.117175 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.117349 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.117483 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.117606 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.117717 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.117820 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.117948 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.118335 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.118464 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.118593 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.118719 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.118840 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.118975 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.119112 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.119236 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.119357 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.119485 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.119607 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.119719 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.119836 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.119950 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120054 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120156 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120259 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120369 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120473 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120575 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120678 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120782 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.120895 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.121006 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.121127 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.121269 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.121400 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.121522 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.121643 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.121776 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.121900 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.122028 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.122157 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.122278 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.122399 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.122528 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.122528 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.122528 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.122878 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.123047 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.123181 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.123304 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.123432 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.123553 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.123674 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.123795 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.123925 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.124047 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.124167 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.124288 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.124409 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.124542 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.124673 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.124795 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.124924 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.125053 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.125181 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.125302 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.125435 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.125564 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.125694 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.125815 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.125936 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.126065 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.126738 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.126932 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.127195 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.127195 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.127559 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.127699 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.127823 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.127944 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.128065 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.128187 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.128308 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.128437 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.128559 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.128690 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.128812 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.128941 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.129062 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.129197 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.129320 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.129442 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.129562 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.129728 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.129854 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.130052 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.130181 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.130377 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.130502 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.130680 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.130814 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.131072 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.131208 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.131332 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.131453 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.131615 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.131819 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.131953 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.132076 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.132223 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.132350 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.132533 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.132672 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.132846 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.132972 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.133158 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.133284 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.133467 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.133601 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.133777 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.133902 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.134084 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.134209 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.134395 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.134523 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.134705 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.134831 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.135032 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.135159 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.135348 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.135475 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.135653 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.135777 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.135960 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.136086 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.136271 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.136397 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.136577 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.136701 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.136886 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.137010 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.137192 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.137319 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.137485 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.137610 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.137800 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.137934 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.138109 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.138239 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.138425 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.138552 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.138733 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.138867 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.139134 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.139292 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.139416 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.139536 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.139732 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.139868 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.140036 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.140161 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.140391 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.140516 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.140706 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.140841 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.141025 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.141163 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.141349 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.141472 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.141626 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.141762 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.142052 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.142233 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.142382 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.142514 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.142672 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.142801 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.143076 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.143206 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.143385 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.143511 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.143690 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.143818 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.144013 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.144146 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.144317 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.144443 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.144635 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.144759 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.144945 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.145071 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.145254 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.145388 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.145585 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.145711 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.145897 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.146023 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.146225 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.146360 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.146622 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.146753 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.146967 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.147128 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.147278 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.147416 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.147595 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.147731 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.147896 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.148030 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.148210 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.148336 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.148520 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.148658 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.148844 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.148970 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.149168 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.149295 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.149480 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.149614 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.149796 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.149932 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.150101 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.150228 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.150423 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.150558 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.150744 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.150876 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.151081 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.151214 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.151399 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.151524 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.151710 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.151837 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.152039 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.152172 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.152365 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.152492 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.152681 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.152814 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.153008 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.153135 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.153319 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.153443 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.153624 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.153750 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.153933 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.154067 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.154239 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.154371 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.154544 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.154669 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.154867 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.155017 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.155193 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.155319 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.155502 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.155635 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.155811 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.155945 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.156121 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.156246 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.156424 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.156551 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.156727 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.156862 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.157054 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.157179 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.157355 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.158032 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.158200 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.158327 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.158511 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.158646 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.158818 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.158968 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.159169 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.159305 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.159476 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.159604 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.159804 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.159930 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.160122 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.160255 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.160452 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.160579 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.160776 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.160902 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.161085 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.161212 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.161410 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.161528 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.161721 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.161856 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.162030 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.162156 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.162336 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.162462 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.162645 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.162780 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.163013 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.163145 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.163322 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.163451 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.163641 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.163782 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.163975 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.164100 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.164288 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.164412 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.164610 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.164737 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.164939 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.165065 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.165247 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.165380 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.165553 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.165680 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.165865 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.165992 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.166423 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.166550 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.166732 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.166858 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.167062 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.167181 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.167373 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.167496 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.167681 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.167986 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.168145 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.168280 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.168412 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.168587 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.168719 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.168894 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.169020 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.169199 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.169331 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.169507 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.169641 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.169811 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.169936 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.170119 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.170254 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.170424 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.170550 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.170749 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.170873 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.171084 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.171227 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.171391 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.171509 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.171700 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.171826 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.171996 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.172122 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.172330 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.172462 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.172636 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.172760 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.172947 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.173109 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.173973 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.174138 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.174310 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.174448 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.174637 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.174762 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.174981 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.175122 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.175301 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.175445 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.175622 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.175762 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.175942 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.176068 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.176266 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.176401 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.176634 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.176808 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.176941 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.177140 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.177275 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.177463 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.177588 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.177780 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.178128 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.178259 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.178391 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.178498 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.178710 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.178836 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.179047 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.179176 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.179362 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.179497 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.179676 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.179802 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.179990 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.180189 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.180320 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.180442 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.180616 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.180742 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.180934 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.181074 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.181250 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.181377 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.181573 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.181698 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.181891 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.182025 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.182206 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.182331 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.182521 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.182647 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.182850 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.182994 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.183200 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.183365 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.183488 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.183608 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.183806 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.183933 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.184121 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.184255 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.184434 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.184568 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.184748 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.184874 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.185060 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.185186 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.185374 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.185508 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.185687 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.185823 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.186000 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.186117 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.186309 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.186434 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.186622 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.186748 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.186956 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.187097 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.187291 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.187407 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.187576 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.187703 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.187893 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.188028 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.188208 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.188340 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.188515 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.188640 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.188884 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.189019 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.189210 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.189528 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.189652 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.189846 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.189973 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.190171 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.190297 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.190501 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.190692 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.190819 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.191039 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.191189 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.191382 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.191508 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.191714 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.191833 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.192045 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.192182 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.192367 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.192494 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.192678 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.192810 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.192992 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.193120 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.193299 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.193425 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.193606 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.193730 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.193922 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.194048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.194225 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.194343 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.194531 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.194655 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.194845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.195003 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.195185 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.195398 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.195526 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.195752 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.195887 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.196103 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.196235 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.196522 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.196647 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.196858 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.196985 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.197179 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.197313 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.197493 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.197619 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.197820 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.197946 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.198130 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.198293 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.198419 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.198541 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.198738 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.198865 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.199074 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.199202 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.199381 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.199509 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.199686 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.199813 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.199996 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.200123 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.200308 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.200444 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.200612 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.200737 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.200920 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.201046 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.201224 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.201362 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.201526 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.201652 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.201838 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.201957 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.202139 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.202271 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.202442 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.202576 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.202752 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.202879 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.203080 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.203220 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.203386 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.203527 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.203690 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.203814 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.203992 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.204118 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.204898 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.205059 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.205183 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.205306 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.205438 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.205561 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.205693 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.205836 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.205997 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.206124 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.206312 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.206447 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.206621 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.206748 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.207017 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.207148 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.207381 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.207509 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.207685 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.207818 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.207989 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.208122 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.208303 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.208463 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.208610 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.208741 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.208917 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.209052 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.209228 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.209352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.209538 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.209670 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.209863 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.210004 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.210178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.210303 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.210490 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.210705 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.210838 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.211062 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.211190 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.211382 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.211700 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.211834 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.212034 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.212160 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.212341 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.212468 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.212646 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.212771 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.212951 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.213078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.213275 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.213402 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.213585 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.213711 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.213891 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.214016 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.214199 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.214334 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.214507 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.214632 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.214819 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.214962 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.215143 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.215268 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.215442 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.215587 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.215752 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.215877 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.216061 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.216187 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.216370 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.216514 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.216678 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.216804 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.216986 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.217109 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.217292 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.217487 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.217612 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.217723 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.217898 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.218021 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.218211 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.218338 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.218522 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.218650 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.218838 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.218994 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.219178 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.219303 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.219497 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.219622 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.219807 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.219968 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.220671 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.220806 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.221101 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.221233 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.221418 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.221553 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.221739 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.221865 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.222065 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.222189 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.222378 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.222512 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.222687 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.222814 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.223045 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.223364 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.223488 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.223673 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.223800 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.224005 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.224328 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.224461 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.224643 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.224778 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.224969 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.225095 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.225297 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.225421 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.225591 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.225720 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.225913 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.226043 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.226226 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.226352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.226546 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.226673 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.226875 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.227072 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.227226 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.227359 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.227537 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.227662 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.227850 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.227976 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.228156 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.228291 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.228462 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.228622 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.228774 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.228900 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.229092 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.229234 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.229398 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.229522 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.229700 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.229832 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.230003 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.230139 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.230313 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.230439 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.230617 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.230742 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.230933 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.231061 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.231244 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.231382 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.231549 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.231676 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.231856 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.231982 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.232156 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.232287 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.232460 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.232584 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.232760 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.232892 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.233062 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.233188 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.233363 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.233489 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.233666 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.233791 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.233973 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.234107 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.234274 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.234407 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.234577 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.234702 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.234876 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.235020 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.235254 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.235406 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.235553 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.235682 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.235857 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.235993 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.236274 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.236410 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.236579 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.236711 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.236909 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.237033 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.237246 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.237411 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.237568 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.237899 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.238217 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.238546 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.238830 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.238990 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.239202 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.239529 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.239852 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.240169 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.240505 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.240630 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.240822 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.241006 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.241130 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.241441 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.241757 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.242072 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.242387 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.242557 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.242718 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.242933 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.243074 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.243283 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.243395 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.243643 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.243756 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.243977 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.244100 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.244312 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.244425 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.244630 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.244741 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.244956 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.245070 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.245277 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.245396 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.245594 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.245714 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.245910 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.246023 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.246226 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.246340 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.246609 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.246740 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.246874 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.247024 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.247170 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.247275 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.247488 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.247615 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.247802 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.247915 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.248124 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.248236 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.248446 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.248559 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.248776 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.248891 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.249094 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.249206 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.249390 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.249497 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.249712 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.249824 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.250029 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.250142 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.250357 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.250566 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.250765 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.250982 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.251120 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.251329 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.251525 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.251656 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.251788 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.251938 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.252065 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.252261 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.252389 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.252574 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.252699 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.252820 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 03:39:02.253012 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.253344 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.253694 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.254010 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.254361 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.254694 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.255039 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.255356 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.255666 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:39:02.255914 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 03:39:02.404908 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO dbcounter [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Registered counter for database nova_api Sep 16 03:39:02.409550 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO dbcounter [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Registered counter for database nova_api Sep 16 03:39:02.426747 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_db.sqlalchemy.engines [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:39:02.429335 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_db.sqlalchemy.engines [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:39:02.433548 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writer thread running {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:39:02.435764 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writer thread running {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:39:02.492844 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.context [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),035a2354-99fe-448b-a23d-f019d795a350(cell1) {{(pid=112558) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 03:39:02.496695 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:39:02.497168 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:39:02.498724 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:39:02.499475 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:39:02.499918 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:39:02.502243 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:39:02.504230 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.context [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),035a2354-99fe-448b-a23d-f019d795a350(cell1) {{(pid=112557) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 03:39:02.504331 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO dbcounter [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Registered counter for database nova_cell0 Sep 16 03:39:02.508247 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO dbcounter [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Registered counter for database nova_cell1 Sep 16 03:39:02.510695 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_concurrency.lockutils [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:39:02.511358 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_concurrency.lockutils [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:39:02.513626 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_concurrency.lockutils [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:39:02.514761 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_concurrency.lockutils [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:39:02.515543 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_concurrency.lockutils [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:39:02.517802 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_db.sqlalchemy.engines [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:39:02.519142 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_concurrency.lockutils [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:39:02.519710 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_db.sqlalchemy.engines [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:39:02.522070 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO dbcounter [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Registered counter for database nova_cell0 Sep 16 03:39:02.525989 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writer thread running {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:39:02.526372 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO dbcounter [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Registered counter for database nova_cell1 Sep 16 03:39:02.527513 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writer thread running {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:39:02.534472 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_db.sqlalchemy.engines [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:39:02.536240 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_db.sqlalchemy.engines [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:39:02.541943 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writer thread running {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:39:02.547114 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writer thread running {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:39:02.670328 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO dbcounter [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Registered counter for database nova_cell0 Sep 16 03:39:02.677283 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_db.sqlalchemy.engines [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:39:02.681960 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writer thread running {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:39:02.688476 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO dbcounter [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Registered counter for database nova_cell0 Sep 16 03:39:02.697832 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG oslo_db.sqlalchemy.engines [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:39:02.702491 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writer thread running {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:39:03.118184 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: WARNING keystonemiddleware.auth_token [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 03:39:03.125441 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: WARNING keystonemiddleware.auth_token [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 03:39:03.149849 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: WARNING keystonemiddleware.auth_token [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 03:39:03.157136 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: WARNING keystonemiddleware.auth_token [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 03:39:03.466647 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: WARNING keystonemiddleware.auth_token [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 03:39:03.473233 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: WARNING keystonemiddleware.auth_token [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 03:39:03.478573 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2e67499c0 pid: 112558 (default app) Sep 16 03:39:03.480648 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:39:03.481802 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001701 Sep 16 03:39:03.482276 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Fri Sep 16 03:39:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:39:03.513162 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: WARNING keystonemiddleware.auth_token [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 03:39:03.520394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: WARNING keystonemiddleware.auth_token [None req-bb0ba939-56b6-4fd4-bbd3-3a144d631430 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 03:39:03.525636 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2e67499c0 pid: 112557 (default app) Sep 16 03:40:28.466245 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:28.467291 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 16 03:40:28.471277 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:28.485935 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writing DB stats nova_api:SELECT=3 {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:28.487751 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writing DB stats nova_cell0:SELECT=3 {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:28.488589 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writing DB stats nova_cell1:SELECT=3 {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:28.489298 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:29.402236 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-34f317ca-1ca8-4d47-9db5-cf4d93851e3e admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:29.434616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-34f317ca-1ca8-4d47-9db5-cf4d93851e3e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.959897 Sep 16 03:40:29.435387 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1292 bytes} [Fri Sep 16 03:40:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:40:32.056302 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:32.057318 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-7b183da5-66e5-4a99-8fbc-cb690c5502da None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 16 03:40:32.065417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:32.508222 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-9cae38a8-8092-42c9-9ad2-c5eb37cffbba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1"}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:32.597484 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-9cae38a8-8092-42c9-9ad2-c5eb37cffbba admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.531095 Sep 16 03:40:32.598342 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:40:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:40:32.612477 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_api:SELECT=3 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:32.613344 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_cell0:SELECT=3 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:32.615366 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_cell1:SELECT=3 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:32.616228 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:32.821680 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-431d3f45-2762-4edc-809f-dfaa71a78329 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:32.983253 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-431d3f45-2762-4edc-809f-dfaa71a78329 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.376106 Sep 16 03:40:32.983861 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 16 03:40:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:40:35.553068 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-9cae38a8-8092-42c9-9ad2-c5eb37cffbba admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:35.554081 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-9cae38a8-8092-42c9-9ad2-c5eb37cffbba admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 16 03:40:35.554491 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:36.211552 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-ad984ff2-3c07-4696-be9b-03f2dc1969b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:36.330656 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-ad984ff2-3c07-4696-be9b-03f2dc1969b3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.769860 Sep 16 03:40:36.339842 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:40:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:40:36.343499 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-72bf6b90-e9f6-48fd-b749-3f2e36ff704a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:36.459368 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-72bf6b90-e9f6-48fd-b749-3f2e36ff704a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119247 Sep 16 03:40:36.459978 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 16 03:40:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:40:39.060545 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-ad984ff2-3c07-4696-be9b-03f2dc1969b3 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:39.061715 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-ad984ff2-3c07-4696-be9b-03f2dc1969b3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Sep 16 03:40:39.062282 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:39.502251 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-03a26f12-ecfd-4eab-b8e5-8ad7ec9d73d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:39.587564 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-03a26f12-ecfd-4eab-b8e5-8ad7ec9d73d0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518978 Sep 16 03:40:39.588125 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:40:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:40:39.601033 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-28d29030-1c9d-4a9e-a3a9-e9de1ffa7785 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:39.712797 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-28d29030-1c9d-4a9e-a3a9-e9de1ffa7785 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115300 Sep 16 03:40:39.713164 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 16 03:40:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:40:42.405492 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-03a26f12-ecfd-4eab-b8e5-8ad7ec9d73d0 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:42.406491 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-03a26f12-ecfd-4eab-b8e5-8ad7ec9d73d0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 16 03:40:42.406945 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:42.830647 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-d5bd63c4-32b4-4472-a37a-037f88270f58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:42.988617 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-d5bd63c4-32b4-4472-a37a-037f88270f58 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.574567 Sep 16 03:40:43.022255 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:40:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:40:43.022429 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-1ee98506-53d9-4831-ab1a-d8f408ac0a63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:43.242753 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-1ee98506-53d9-4831-ab1a-d8f408ac0a63 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.244194 Sep 16 03:40:43.243506 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 16 03:40:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:40:45.981574 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-d5bd63c4-32b4-4472-a37a-037f88270f58 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:45.982785 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-d5bd63c4-32b4-4472-a37a-037f88270f58 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001769 Sep 16 03:40:45.983350 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:46.439660 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-5d7bd1e9-d441-4e80-9321-fc5817cd5433 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G"}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:46.537483 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-5d7bd1e9-d441-4e80-9321-fc5817cd5433 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.545903 Sep 16 03:40:46.537992 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:40:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:40:46.552425 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-586005bf-b513-4a93-969e-ada308ea4c3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:46.666171 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-586005bf-b513-4a93-969e-ada308ea4c3f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118479 Sep 16 03:40:46.666761 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 16 03:40:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:40:49.820972 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-5d7bd1e9-d441-4e80-9321-fc5817cd5433 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:49.822115 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-5d7bd1e9-d441-4e80-9321-fc5817cd5433 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Sep 16 03:40:49.822670 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:50.262230 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-395b6b0a-3b3d-495e-804a-878a4760c6d9 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:50.288009 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-395b6b0a-3b3d-495e-804a-878a4760c6d9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458666 Sep 16 03:40:50.288565 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1292 bytes} [Fri Sep 16 03:40:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:40:53.033358 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-5d7bd1e9-d441-4e80-9321-fc5817cd5433 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:53.034371 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-5d7bd1e9-d441-4e80-9321-fc5817cd5433 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 16 03:40:53.034773 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:53.463647 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-eaeb9492-b765-4949-93c2-aa63fdddbc2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "id": "1"}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:53.559206 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-eaeb9492-b765-4949-93c2-aa63fdddbc2b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518197 Sep 16 03:40:53.559775 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:40:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:40:53.572520 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-79d81dbd-5072-439f-96fc-86ff62f789ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:53.699831 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-79d81dbd-5072-439f-96fc-86ff62f789ab admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130789 Sep 16 03:40:53.700630 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 16 03:40:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:40:56.368335 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-eaeb9492-b765-4949-93c2-aa63fdddbc2b admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:56.369377 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-eaeb9492-b765-4949-93c2-aa63fdddbc2b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 16 03:40:56.369881 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:40:56.722446 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-3577b38b-e36f-4c3f-a78d-02fa6af171e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0, "id": "2", "disk": 20, "rxtx_factor": 1.0}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:56.791537 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-3577b38b-e36f-4c3f-a78d-02fa6af171e0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415293 Sep 16 03:40:56.792146 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:40:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:40:56.804364 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-f001cc98-2769-4ac2-9099-b671838fd114 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:40:56.898135 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-f001cc98-2769-4ac2-9099-b671838fd114 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097442 Sep 16 03:40:56.898706 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 16 03:40:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:40:59.650680 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-3577b38b-e36f-4c3f-a78d-02fa6af171e0 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:40:59.651739 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-3577b38b-e36f-4c3f-a78d-02fa6af171e0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 16 03:40:59.652394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:00.099489 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-40a327ac-f3ff-4391-9974-4e180af3e688 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:00.182400 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-40a327ac-f3ff-4391-9974-4e180af3e688 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.522999 Sep 16 03:41:00.183178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:40:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:41:00.196415 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-3d531b2d-3cac-4fff-b240-18dc9e8f384a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:00.201184 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:00.280826 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-3d531b2d-3cac-4fff-b240-18dc9e8f384a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088002 Sep 16 03:41:00.281408 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 16 03:41:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:41:02.959398 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-40a327ac-f3ff-4391-9974-4e180af3e688 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:02.960429 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-40a327ac-f3ff-4391-9974-4e180af3e688 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 16 03:41:02.960831 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:03.396564 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-ccdcf7ec-94ec-42d8-a71d-c8070ae6bc78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "disk": 80}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:03.601648 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-ccdcf7ec-94ec-42d8-a71d-c8070ae6bc78 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.634409 Sep 16 03:41:03.602407 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:41:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:41:03.615685 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-0179bcf5-a395-4a06-9325-0d3bfff08d9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:03.758458 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-0179bcf5-a395-4a06-9325-0d3bfff08d9a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146446 Sep 16 03:41:03.774406 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 16 03:41:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:41:06.412166 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-ccdcf7ec-94ec-42d8-a71d-c8070ae6bc78 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:06.413904 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-ccdcf7ec-94ec-42d8-a71d-c8070ae6bc78 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002180 Sep 16 03:41:06.414511 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:06.867745 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-0889b217-65c0-4ab5-85a6-5b255b8f1b4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:06.877902 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:07.026608 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-0889b217-65c0-4ab5-85a6-5b255b8f1b4a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.605316 Sep 16 03:41:07.027825 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 16 03:41:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:41:07.041586 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-d2cd813b-bb09-4211-8a0f-2847c414713f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:07.179601 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-d2cd813b-bb09-4211-8a0f-2847c414713f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141727 Sep 16 03:41:07.190938 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 16 03:41:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:41:24.409571 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-0889b217-65c0-4ab5-85a6-5b255b8f1b4a admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:24.410717 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-0889b217-65c0-4ab5-85a6-5b255b8f1b4a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Sep 16 03:41:24.411233 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:24.422071 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:24.801394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-acd01305-3eb9-42eb-8c23-b4407ea7b52e admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:24.819085 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-acd01305-3eb9-42eb-8c23-b4407ea7b52e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401710 Sep 16 03:41:24.819621 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1292 bytes} [Fri Sep 16 03:41:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:41:26.133478 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-0889b217-65c0-4ab5-85a6-5b255b8f1b4a admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:26.134463 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-0889b217-65c0-4ab5-85a6-5b255b8f1b4a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Sep 16 03:41:26.134857 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:41:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:26.780274 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-c8110feb-8311-4f7e-b45e-e76a3d0be20f admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:26.786083 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.wsgi [None req-c8110feb-8311-4f7e-b45e-e76a3d0be20f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-c8110feb-8311-4f7e-b45e-e76a3d0be20f admin admin] Request method failure captured: Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Accept: application/json Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Accept-Encoding: gzip, deflate Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Connection: keep-alive Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Content-Length: 0 Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Host: 10.222.0.49 Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Openstack-Api-Version: compute 2.92 Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Openstack-System-Scope: None Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: User-Agent: python-novaclient Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Auth-Token: gAAAAABjI_BmW3l2pnzd4OjfFaw2_gC_uuLNLFlLn9QRB_VG7p7penJuq2Ff0jx0PPcDCwzR0NGb2o_iCZ4-YM6ohL6u5VWvt_ANPtYvYivdrEh38KQLI8DPhXg_f7l_J2E71I4dbP9YCsv0wdevFhiQdaCNjQkVuCYCr8JurtOT9xyxoQIBkwI Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Domain-Id: None Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Domain-Name: None Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Identity-Status: Confirmed Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Is-Admin-Project: True Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Domain-Id: default Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Domain-Name: Default Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Name: admin Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Role: reader,admin,member Sep 16 03:41:26.789394 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Roles: reader,admin,member Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}] Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant: admin Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant-Name: admin Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User: admin Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Domain-Id: default Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Domain-Name: Default Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Id: 3e71cde4d415471495fcc3441fcdfc54 Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Name: admin Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: method: > Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: exception: Flavor 42 could not be found. Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: action_args: {'id': '42'} Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:41:26.791040 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:26.792048 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.793495 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-c8110feb-8311-4f7e-b45e-e76a3d0be20f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:41:26.795185 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-c8110feb-8311-4f7e-b45e-e76a3d0be20f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.516605 Sep 16 03:41:26.795185 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Sep 16 03:41:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 518 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:26.802157 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-f1ba04f5-bcd6-4b81-872f-8762bc18d835 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:26.823768 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-f1ba04f5-bcd6-4b81-872f-8762bc18d835 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025616 Sep 16 03:41:26.824291 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 16 03:41:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:41:26.835344 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-78547679-4003-4f93-baf9-54e9c8e163d7 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:26.857756 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-78547679-4003-4f93-baf9-54e9c8e163d7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026900 Sep 16 03:41:26.858229 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 16 03:41:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:41:26.868273 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-009895e3-9017-4a70-8b1c-af9e5d1af90f admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:26.873999 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.wsgi [None req-009895e3-9017-4a70-8b1c-af9e5d1af90f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-009895e3-9017-4a70-8b1c-af9e5d1af90f admin admin] Request method failure captured: Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Accept: application/json Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Accept-Encoding: gzip, deflate Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Connection: keep-alive Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Content-Length: 0 Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Host: 10.222.0.49 Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Openstack-Api-Version: compute 2.92 Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Openstack-System-Scope: None Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: User-Agent: python-novaclient Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Auth-Token: gAAAAABjI_BmW3l2pnzd4OjfFaw2_gC_uuLNLFlLn9QRB_VG7p7penJuq2Ff0jx0PPcDCwzR0NGb2o_iCZ4-YM6ohL6u5VWvt_ANPtYvYivdrEh38KQLI8DPhXg_f7l_J2E71I4dbP9YCsv0wdevFhiQdaCNjQkVuCYCr8JurtOT9xyxoQIBkwI Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Domain-Id: None Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Domain-Name: None Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Identity-Status: Confirmed Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Is-Admin-Project: True Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Domain-Id: default Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Domain-Name: Default Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Name: admin Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Role: reader,admin,member Sep 16 03:41:26.878352 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Roles: reader,admin,member Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}] Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant: admin Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant-Name: admin Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User: admin Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Domain-Id: default Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Domain-Name: Default Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Id: 3e71cde4d415471495fcc3441fcdfc54 Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Name: admin Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: method: > Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: exception: Flavor 42 could not be found. Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: action_args: {'id': '42'} Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:41:26.885093 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:26.886078 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:26.887403 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-009895e3-9017-4a70-8b1c-af9e5d1af90f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:41:26.888623 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-009895e3-9017-4a70-8b1c-af9e5d1af90f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015064 Sep 16 03:41:26.888623 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Sep 16 03:41:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:28.175712 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-78547679-4003-4f93-baf9-54e9c8e163d7 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:28.176747 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-78547679-4003-4f93-baf9-54e9c8e163d7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 16 03:41:28.177166 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:28.709515 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-2ac98477-eaf3-4506-bca6-2829dcd87f08 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:28.714670 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.wsgi [None req-2ac98477-eaf3-4506-bca6-2829dcd87f08 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-2ac98477-eaf3-4506-bca6-2829dcd87f08 admin admin] Request method failure captured: Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Accept: application/json Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Accept-Encoding: gzip, deflate Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Connection: keep-alive Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Content-Length: 0 Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Host: 10.222.0.49 Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Openstack-Api-Version: compute 2.92 Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Openstack-System-Scope: None Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: User-Agent: python-novaclient Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Auth-Token: gAAAAABjI_Bo4MzuxlIzQl3jeFXx1ZWZTKEuz8Q5OGtiTiN6urSBBoK8Q4tyqjql2XQW3C7OKNk7E2qoKP854zOvU9Z9AWx358PjJOROBV_4VpXCxQbZBkn44ymD3xvMf4IsHlJbgdVeCFVOdqB6JDe68DucCu-H0b63EqM-lCsRaKxL2d2fq1k Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Domain-Id: None Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Domain-Name: None Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Identity-Status: Confirmed Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Is-Admin-Project: True Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Domain-Id: default Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Domain-Name: Default Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Name: admin Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Role: reader,admin,member Sep 16 03:41:28.716257 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Roles: reader,admin,member Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}] Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant: admin Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant-Name: admin Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User: admin Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Domain-Id: default Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Domain-Name: Default Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Id: 3e71cde4d415471495fcc3441fcdfc54 Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Name: admin Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: method: > Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: exception: Flavor 84 could not be found. Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: action_args: {'id': '84'} Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:41:28.717913 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:28.719417 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.720556 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-2ac98477-eaf3-4506-bca6-2829dcd87f08 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:41:28.721592 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-2ac98477-eaf3-4506-bca6-2829dcd87f08 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.401721 Sep 16 03:41:28.721592 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Sep 16 03:41:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:28.728260 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-d5fdec5d-1717-488d-bbe0-f7fcaacdd30f admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:28.743236 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-d5fdec5d-1717-488d-bbe0-f7fcaacdd30f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018466 Sep 16 03:41:28.743789 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 16 03:41:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:41:28.753077 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-e1373c0e-c330-4978-acc4-01b73206260c admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:28.768581 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-e1373c0e-c330-4978-acc4-01b73206260c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019064 Sep 16 03:41:28.769088 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 16 03:41:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:41:28.778447 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-69b64a8a-fee9-4d5c-944b-c600dcc3c4e6 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:28.784574 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.wsgi [None req-69b64a8a-fee9-4d5c-944b-c600dcc3c4e6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-69b64a8a-fee9-4d5c-944b-c600dcc3c4e6 admin admin] Request method failure captured: Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Accept: application/json Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Accept-Encoding: gzip, deflate Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Connection: keep-alive Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Content-Length: 0 Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Host: 10.222.0.49 Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Openstack-Api-Version: compute 2.92 Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Openstack-System-Scope: None Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: User-Agent: python-novaclient Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Auth-Token: gAAAAABjI_Bo4MzuxlIzQl3jeFXx1ZWZTKEuz8Q5OGtiTiN6urSBBoK8Q4tyqjql2XQW3C7OKNk7E2qoKP854zOvU9Z9AWx358PjJOROBV_4VpXCxQbZBkn44ymD3xvMf4IsHlJbgdVeCFVOdqB6JDe68DucCu-H0b63EqM-lCsRaKxL2d2fq1k Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Domain-Id: None Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Domain-Name: None Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Identity-Status: Confirmed Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Is-Admin-Project: True Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Domain-Id: default Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Domain-Name: Default Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Name: admin Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Role: reader,admin,member Sep 16 03:41:28.786075 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Roles: reader,admin,member Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}] Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant: admin Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant-Name: admin Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User: admin Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Domain-Id: default Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Domain-Name: Default Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Id: 3e71cde4d415471495fcc3441fcdfc54 Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Name: admin Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: method: > Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: exception: Flavor 84 could not be found. Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: action_args: {'id': '84'} Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:41:28.787616 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:28.788769 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:28.789852 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-69b64a8a-fee9-4d5c-944b-c600dcc3c4e6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:41:28.790946 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-69b64a8a-fee9-4d5c-944b-c600dcc3c4e6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012619 Sep 16 03:41:28.790946 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Sep 16 03:41:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:30.021163 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-e1373c0e-c330-4978-acc4-01b73206260c admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:30.022165 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-e1373c0e-c330-4978-acc4-01b73206260c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 16 03:41:30.022554 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:30.566894 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-4bf37b36-b683-4ae1-90de-d92fd9dd81f4 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:30.572591 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.wsgi [None req-4bf37b36-b683-4ae1-90de-d92fd9dd81f4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-4bf37b36-b683-4ae1-90de-d92fd9dd81f4 admin admin] Request method failure captured: Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Accept: application/json Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Accept-Encoding: gzip, deflate Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Connection: keep-alive Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Content-Length: 0 Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Host: 10.222.0.49 Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Openstack-Api-Version: compute 2.92 Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Openstack-System-Scope: None Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: User-Agent: python-novaclient Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Auth-Token: gAAAAABjI_BpsGPRFO5M4HXUAecbgrid8QHK2kNF5lgImq7ELHGi62WBGUNEKdB_6Qj4YbZEg8B7kI1P3VulpFSNczUU99J6ydNhDRT0csf9MTjm_SWIZp4xualFUPAv9Dy1ezyyuhzZi3jrynUS61FN03Kn3QH6dw11PVGjMxy6Nm5hHoh15Z0 Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Domain-Id: None Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Domain-Name: None Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Identity-Status: Confirmed Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Is-Admin-Project: True Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Domain-Id: default Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Domain-Name: Default Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Project-Name: admin Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Role: reader,admin,member Sep 16 03:41:30.574069 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Roles: reader,admin,member Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}] Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant: admin Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-Tenant-Name: admin Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User: admin Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Domain-Id: default Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Domain-Name: Default Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Id: 3e71cde4d415471495fcc3441fcdfc54 Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: X-User-Name: admin Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: method: > Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: exception: Flavor 451 could not be found. Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: action_args: {'id': '451'} Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:41:30.575746 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:30.576845 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.578315 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-4bf37b36-b683-4ae1-90de-d92fd9dd81f4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:41:30.579599 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-4bf37b36-b683-4ae1-90de-d92fd9dd81f4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.411691 Sep 16 03:41:30.579599 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 16 03:41:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:30.585154 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-3d34b2cb-1b42-4425-9b58-50978099770b admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:30.600322 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-3d34b2cb-1b42-4425-9b58-50978099770b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018695 Sep 16 03:41:30.600864 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 16 03:41:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:41:30.611030 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:30.625946 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019207 Sep 16 03:41:30.626502 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 16 03:41:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:41:30.635747 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-1046fc02-015d-4d14-b00a-9719b030dda4 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:30.640629 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.wsgi [None req-1046fc02-015d-4d14-b00a-9719b030dda4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-1046fc02-015d-4d14-b00a-9719b030dda4 admin admin] Request method failure captured: Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Accept: application/json Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Accept-Encoding: gzip, deflate Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Connection: keep-alive Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Content-Length: 0 Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Host: 10.222.0.49 Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Openstack-Api-Version: compute 2.92 Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Openstack-System-Scope: None Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: User-Agent: python-novaclient Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Auth-Token: gAAAAABjI_BpsGPRFO5M4HXUAecbgrid8QHK2kNF5lgImq7ELHGi62WBGUNEKdB_6Qj4YbZEg8B7kI1P3VulpFSNczUU99J6ydNhDRT0csf9MTjm_SWIZp4xualFUPAv9Dy1ezyyuhzZi3jrynUS61FN03Kn3QH6dw11PVGjMxy6Nm5hHoh15Z0 Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Domain-Id: None Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Domain-Name: None Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Identity-Status: Confirmed Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Is-Admin-Project: True Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Domain-Id: default Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Domain-Name: Default Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Project-Name: admin Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Role: reader,admin,member Sep 16 03:41:30.642178 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Roles: reader,admin,member Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ccdd7a44ba5049fb939dad44d5bd406e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ccdd7a44ba5049fb939dad44d5bd406e"}]}] Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant: admin Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant-Id: ccdd7a44ba5049fb939dad44d5bd406e Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-Tenant-Name: admin Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User: admin Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Domain-Id: default Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Domain-Name: Default Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Id: 3e71cde4d415471495fcc3441fcdfc54 Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: X-User-Name: admin Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: method: > Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: exception: Flavor 451 could not be found. Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: action_args: {'id': '451'} Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:41:30.643805 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:30.644786 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: ERROR nova.api.openstack.wsgi Sep 16 03:41:30.646081 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-1046fc02-015d-4d14-b00a-9719b030dda4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:41:30.647412 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-1046fc02-015d-4d14-b00a-9719b030dda4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011327 Sep 16 03:41:30.647412 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 16 03:41:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 16 03:41:31.861267 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:31.862260 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 16 03:41:31.862649 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:32.380618 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-f666827b-ddf6-407b-ac93-26a33c7a7677 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:32.473702 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-f666827b-ddf6-407b-ac93-26a33c7a7677 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.470034 Sep 16 03:41:32.475717 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Sep 16 03:41:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:41:33.689198 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:33.690209 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Sep 16 03:41:33.690624 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:41:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:34.214050 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-d45ae8f4-111f-4508-b219-6dc55ab82021 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:34.306409 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-d45ae8f4-111f-4508-b219-6dc55ab82021 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.478268 Sep 16 03:41:34.307204 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Sep 16 03:41:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:41:35.522370 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:35.523398 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 16 03:41:35.523792 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:36.043053 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-69c9ab6d-7d64-47c2-b14c-80da24891c46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:36.123774 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-69c9ab6d-7d64-47c2-b14c-80da24891c46 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.464231 Sep 16 03:41:36.124319 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Sep 16 03:41:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:41:37.399568 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:37.400571 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 16 03:41:37.400962 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:41:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:37.923525 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-984b06a1-9e62-47e6-8dd2-70730ce0a329 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:41:38.006980 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-984b06a1-9e62-47e6-8dd2-70730ce0a329 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.468956 Sep 16 03:41:38.007519 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Sep 16 03:41:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:41:39.221733 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:39.222722 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 16 03:41:39.223143 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:41:39.749652 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-7bc0765a-ea5b-4b96-83cb-2ffc6f6af27b admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:41:39.769753 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-7bc0765a-ea5b-4b96-83cb-2ffc6f6af27b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.410100 Sep 16 03:41:39.770289 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Fri Sep 16 03:41:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:42:38.088690 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:42:38.089691 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-71ef4bd7-1a9a-4531-8488-928fc96b7589 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 16 03:42:38.090086 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 16 03:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:42:38.101366 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:38.481800 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-6387e15e-57bf-4222-85d4-b8cb3be7e4d0 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:42:38.503008 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-6387e15e-57bf-4222-85d4-b8cb3be7e4d0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406056 Sep 16 03:42:38.503544 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1292 bytes} [Fri Sep 16 03:42:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:42:38.524791 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG dbcounter [-] [112557] Writing DB stats nova_api:SELECT=14 {{(pid=112557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:38.528552 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-c187f58f-64d7-4b3d-bf00-3e7c2bf446c9 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:42:38.536335 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-c187f58f-64d7-4b3d-bf00-3e7c2bf446c9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012643 Sep 16 03:42:38.536426 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1283 bytes} [Fri Sep 16 03:42:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:42:38.549069 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-f30a5e31-db26-4ba7-9c84-96e1399dd891 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:42:38.556289 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-f30a5e31-db26-4ba7-9c84-96e1399dd891 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011739 Sep 16 03:42:38.564424 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1286 bytes} [Fri Sep 16 03:42:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:42:38.568579 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:42:38.575730 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010724 Sep 16 03:42:38.576286 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1286 bytes} [Fri Sep 16 03:42:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:42:38.588677 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-b88e0fe1-6cac-4c62-a63d-bff77bde4fd4 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:42:38.596034 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-b88e0fe1-6cac-4c62-a63d-bff77bde4fd4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010863 Sep 16 03:42:38.596540 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1283 bytes} [Fri Sep 16 03:42:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:46:12.443238 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:46:12.444283 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 16 03:46:12.444669 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:46:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:46:12.590691 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_api:SELECT=6 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:46:12.739283 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-99d0151e-2b45-4914-b610-d615a3504765 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:46:12.743961 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-99d0151e-2b45-4914-b610-d615a3504765 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:46:12.744429 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-99d0151e-2b45-4914-b610-d615a3504765 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:46:12.744856 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-99d0151e-2b45-4914-b610-d615a3504765 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:46:12.745566 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-99d0151e-2b45-4914-b610-d615a3504765 admin admin] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:46:12.746010 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-99d0151e-2b45-4914-b610-d615a3504765 admin admin] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:46:12.746430 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-99d0151e-2b45-4914-b610-d615a3504765 admin admin] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:46:12.779065 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-99d0151e-2b45-4914-b610-d615a3504765 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.189358 Sep 16 03:46:12.779616 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 16 03:46:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:46:13.858806 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:46:13.859828 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 16 03:46:13.860243 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:46:14.053539 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-8af65033-e4b8-4ec2-b60e-30a4e3736725 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:46:14.056916 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8af65033-e4b8-4ec2-b60e-30a4e3736725 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:46:14.057383 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8af65033-e4b8-4ec2-b60e-30a4e3736725 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:46:14.057808 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8af65033-e4b8-4ec2-b60e-30a4e3736725 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:46:14.058512 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8af65033-e4b8-4ec2-b60e-30a4e3736725 admin admin] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:46:14.058972 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8af65033-e4b8-4ec2-b60e-30a4e3736725 admin admin] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:46:14.059385 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8af65033-e4b8-4ec2-b60e-30a4e3736725 admin admin] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:46:14.079987 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-8af65033-e4b8-4ec2-b60e-30a4e3736725 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077658 Sep 16 03:46:14.080468 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 16 03:46:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:46:25.585221 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:46:25.586175 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 16 03:46:25.586584 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:46:25.731168 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_cell0:SELECT=4 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:46:25.732406 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_cell1:SELECT=4 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:46:25.733030 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG dbcounter [-] [112558] Writing DB stats nova_api:SELECT=8 {{(pid=112558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:46:25.781313 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-f856e644-01d5-40d5-acee-be02fece9fa8 admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:46:25.784757 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-f856e644-01d5-40d5-acee-be02fece9fa8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:46:25.785267 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-f856e644-01d5-40d5-acee-be02fece9fa8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:46:25.785695 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-f856e644-01d5-40d5-acee-be02fece9fa8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:46:25.786410 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-f856e644-01d5-40d5-acee-be02fece9fa8 admin admin] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:46:25.786857 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-f856e644-01d5-40d5-acee-be02fece9fa8 admin admin] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:46:25.787351 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-f856e644-01d5-40d5-acee-be02fece9fa8 admin admin] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:46:25.814935 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-f856e644-01d5-40d5-acee-be02fece9fa8 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.088247 Sep 16 03:46:25.815520 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 16 03:46:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:46:26.921157 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: DEBUG nova.api.openstack.wsgi [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] Calling method '>' {{(pid=112557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:46:26.922159 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: INFO nova.api.openstack.requestlog [None req-035c015a-5b59-4aa0-8320-a92de2e02a38 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 16 03:46:26.922556 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: [pid: 112557|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 16 03:46:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:46:27.154362 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG nova.api.openstack.wsgi [None req-8ba5f399-1e08-4f49-9825-f956870a5eec admin admin] Calling method '>' {{(pid=112558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:46:27.157960 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8ba5f399-1e08-4f49-9825-f956870a5eec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:46:27.158432 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8ba5f399-1e08-4f49-9825-f956870a5eec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:46:27.158858 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8ba5f399-1e08-4f49-9825-f956870a5eec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:46:27.160771 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8ba5f399-1e08-4f49-9825-f956870a5eec admin admin] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:46:27.160771 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8ba5f399-1e08-4f49-9825-f956870a5eec admin admin] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:46:27.160771 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: DEBUG oslo_concurrency.lockutils [None req-8ba5f399-1e08-4f49-9825-f956870a5eec admin admin] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:46:27.183894 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: INFO nova.api.openstack.requestlog [None req-8ba5f399-1e08-4f49-9825-f956870a5eec admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.095545 Sep 16 03:46:27.185552 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: [pid: 112558|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 16 03:46:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:47:26.149200 dv-cinder-857993-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 16 03:47:26.149746 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: Fri Sep 16 03:47:26 2022 - graceful shutdown triggered... Sep 16 03:47:26.150189 dv-cinder-857993-1-iscsi devstack@n-api.service[112557]: Gracefully killing worker 1 (pid: 112557)... Sep 16 03:47:26.150832 dv-cinder-857993-1-iscsi devstack@n-api.service[112558]: Gracefully killing worker 2 (pid: 112558)... Sep 16 03:47:27.151014 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: worker 1 buried after 1 seconds Sep 16 03:47:27.151014 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: worker 2 buried after 1 seconds Sep 16 03:47:27.151014 dv-cinder-857993-1-iscsi devstack@n-api.service[112556]: goodbye to uWSGI. Sep 16 03:47:27.152577 dv-cinder-857993-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 16 03:47:27.153122 dv-cinder-857993-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 16 03:47:27.156571 dv-cinder-857993-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 03:47:27.165725 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 03:47:27 2022] *** Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: nodename: dv-cinder-857993-1-iscsi Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: machine: x86_64 Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: clock source: unix Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: pcre jit disabled Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: detected number of CPU cores: 4 Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: current working directory: / Sep 16 03:47:27.167705 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: detected binary path: /usr/bin/uwsgi-core Sep 16 03:47:27.168497 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: your processes number limit is 47680 Sep 16 03:47:27.168497 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: your memory page size is 4096 bytes Sep 16 03:47:27.168497 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: detected max file descriptor number: 2048 Sep 16 03:47:27.168497 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: lock engine: pthread robust mutexes Sep 16 03:47:27.168497 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: thunder lock: enabled Sep 16 03:47:27.168497 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 03:47:27.168497 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 03:47:27.207794 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: Python main interpreter initialized at 0x55b47c3649c0 Sep 16 03:47:27.207794 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: python threads support enabled Sep 16 03:47:27.207794 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: your server socket listen backlog is limited to 100 connections Sep 16 03:47:27.207794 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: your mercy for graceful operations on workers is 90 seconds Sep 16 03:47:27.208214 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 03:47:27.208292 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: *** Operational MODE: preforking *** Sep 16 03:47:27.208521 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: *** uWSGI is running in multiple interpreter mode *** Sep 16 03:47:27.208521 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: spawned uWSGI master process (pid: 127608) Sep 16 03:47:27.210835 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: spawned uWSGI worker 1 (pid: 127617, cores: 1) Sep 16 03:47:27.210835 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: spawned uWSGI worker 2 (pid: 127618, cores: 1) Sep 16 03:47:27.210835 dv-cinder-857993-1-iscsi devstack@n-api.service[127608]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 03:47:27.208712 dv-cinder-857993-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 16 03:47:27.909623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 03:47:27.953073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 03:47:29.105101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:47:29.105101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: from cryptography.utils import int_from_bytes Sep 16 03:47:29.105734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:47:29.105734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: from cryptography.utils import int_from_bytes Sep 16 03:47:29.167277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:47:29.167277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: from cryptography.utils import int_from_bytes Sep 16 03:47:29.167854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:47:29.167854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: from cryptography.utils import int_from_bytes Sep 16 03:47:31.678862 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 03:47:31.679583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 03:47:31.679666 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 03:47:31.680017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 03:47:31.680276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 03:47:31.680662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.680987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.681314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.681637 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.681966 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.682277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.682600 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.682942 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.683269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.683529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.683846 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.684295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857993-1-iscsi {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.684621 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.684938 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.685248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.685569 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.685873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.686196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.686501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.687117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.687561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.687873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.688184 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.688524 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.688840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.689160 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.689470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.689777 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.690097 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.690411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.690811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857993-1-iscsi {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.691155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.691470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.691785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.692199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.692509 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.692821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.693142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.693506 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.693789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.694116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.694459 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.694757 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.695108 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.695410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.695720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.696029 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.696346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.696649 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.696953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.697202 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.697511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.697833 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.698154 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.698500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.698732 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.699005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.699332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.699653 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.699963 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.700273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.700581 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.700890 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.701197 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.701504 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.701812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.702122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.703008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.703338 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.703664 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.703967 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.704287 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.704700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.704958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.705266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.705612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.705929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.706238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.706559 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.706881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.707216 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.707526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.707834 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.708153 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.708494 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.708802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.709059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.709362 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.709672 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.709991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.710299 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.710607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.710931 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.711238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.711547 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.711854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.712175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.712469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.712774 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.713082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.713388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.713694 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.713999 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.714304 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.714630 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.714985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.715297 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.715607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.715914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.716226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.716548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.716856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.717165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.717488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.717798 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.718803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.719323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.719681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.720157 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.720484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.720791 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.721103 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.721426 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.721738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.722046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.722353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.722659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.722990 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.723297 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.723601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.723906 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.724204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.724526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.724851 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.725172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.725483 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.725788 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.726107 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.726447 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.726781 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.727154 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.727472 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.727805 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.728136 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.728455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.728789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.729092 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.729418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.729733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.730046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.730358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.730679 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.731023 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.731359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.731676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.731993 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.732314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.732628 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.732950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.733277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.733662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.734008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.734467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.734823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.735176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.735508 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.735839 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.736155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.736469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.736784 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.737135 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.737452 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.737768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.738089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.738405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.738734 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.739079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.739394 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.739709 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.740026 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.740339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.740685 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.741006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.741333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.741655 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.741973 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.742294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.742612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.743170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.743295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.743565 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.743874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.744181 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.744497 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.744802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.745134 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.745469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.745779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.746119 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.746429 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.746741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.747081 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.747399 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.747706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.748022 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.748336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.748643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.748969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.749402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.749809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.750144 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.750455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.750766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.751126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.751440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.751756 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.752074 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.752388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.752714 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.753032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.753346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.753687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.754020 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.754329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.754657 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.755019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.755342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.755648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.755958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.756267 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.756576 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.756882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.757193 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.757499 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.757804 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.758109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.758414 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.758719 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.759068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.759382 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.759690 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.759999 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.760306 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.760658 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.760969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.761317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.761658 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.761982 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.762308 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.762625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.762964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.763280 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.763596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.763910 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.764223 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.764547 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.765398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.765726 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.766041 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.766481 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.766810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.767163 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.767474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.767796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.768192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.768482 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.768803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.769130 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.769446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.769766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.770079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.770395 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.770712 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.771052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.771378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.771692 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.772015 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.772329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.772655 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.772969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.773295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.773602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.773919 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.774254 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.774590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.774984 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.775645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.775961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.776272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.776585 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.776894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.777203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.777515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.777830 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.778139 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.778450 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.778756 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.779098 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.779412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.779719 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.780024 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.780336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.781988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.781988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.781988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.782879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.782879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.782879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.783226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.783321 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.784019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.784019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.784230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.784564 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.784940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.785191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.786341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.786341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.786341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.786630 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.786757 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.787098 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.787425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.787741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.788053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.788368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.788683 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.788997 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.789311 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.789637 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.789949 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.790263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.790579 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.790885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.791220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.791543 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.792136 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.792474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.792796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.793119 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.793468 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.793792 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.794124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.794453 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.794771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.795105 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.795420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.795735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.796043 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.796353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.796661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.796972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.797280 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.797591 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.797899 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.798203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.798508 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.798814 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.799155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.799466 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.799780 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.800354 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.800679 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.800991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.801296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.801604 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.801911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.802813 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.803310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.803653 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.803987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.804336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.804645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.804954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.805282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.805597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.805904 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.806209 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.806522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.806831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.807162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.807305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 03:47:31.807739 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.807840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 03:47:31.807942 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.808079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.808181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 03:47:31.808390 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.808487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 03:47:31.808697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.808807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 03:47:31.809008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.809111 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.809313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.809419 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.809633 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.809729 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.809945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.810041 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.810250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.810404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.810554 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.810658 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.810866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.810996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.811203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.811330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.811510 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.811666 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.811848 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.811945 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.812155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.812261 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.812472 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.812711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857993-1-iscsi {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.812815 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.813046 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.813141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.813362 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.813464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.813673 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.813775 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.813985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.814080 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.814288 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.814384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.814614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.814709 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.814945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.815056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.815256 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.815465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.815584 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.815784 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.815878 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.816096 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.816192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.816411 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.816514 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.816743 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.816836 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.817062 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.817156 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.817379 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.817480 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.817684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.817786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.817995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.818099 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.818300 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.818403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.818606 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.818714 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.818938 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.819036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857993-1-iscsi {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.819243 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.819361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.819545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.819682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.819849 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.820008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.820145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.820433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.820551 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.820735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.820884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.821053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.821147 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.821359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.821462 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.821664 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.821758 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.821972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.822067 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.822275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.822371 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.822620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.822715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.822944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.823055 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.823293 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.823387 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.823602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.823697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.823916 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.824015 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.824228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.824324 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.824540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.824634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.824850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.824950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.825162 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.825258 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.825418 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.825521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.825731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.825839 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.826059 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.826161 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.826375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.826467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.826681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.826785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.826977 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.827090 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.827226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.827367 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.828266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.828368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.828600 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.828694 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.828927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.829020 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.829252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.829364 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.829578 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.829672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.829884 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.829985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.830182 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.830280 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.830493 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.830644 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.830803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.830900 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.831144 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.831246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.831458 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.831562 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.831774 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.831879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.832090 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.832193 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.832406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.832500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.832721 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.832837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.833036 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.833138 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.833349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.833449 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.833666 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.833772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.833974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.834076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.834302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.834408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.834610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.834719 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.834950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.835051 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.835249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.835356 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.835567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.835661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.835874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.835980 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.836184 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.836276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.836490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.836590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.836835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.836935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.837144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.837239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.837399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.837524 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.837708 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.837832 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.838016 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.838145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.838341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.838459 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.838655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.838779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.839128 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.839269 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.839434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.839592 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.839854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.839957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.840171 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.840276 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.840488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.840634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.840797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.840892 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.841103 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.841210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.841408 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.841512 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.841718 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.841827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.842027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.842131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.842338 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.842441 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.842643 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.842736 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.842991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.843109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.843404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.843498 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.843715 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.843817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.844039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.844135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.844348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.844449 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.844662 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.844764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.844975 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.845070 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.845304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.845473 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.845618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.845789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.845929 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.846104 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.846256 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.846431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.846567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.846758 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.846875 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.847114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.847212 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.847424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.847527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.847742 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.847844 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.848054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.848158 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.848379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.848473 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.848705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.848807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.849022 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.849128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.849330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.849422 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.849636 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.849728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.849943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.850049 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.850251 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.850347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.850559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.850669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.850866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.851024 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.851199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.851302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.851505 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.851626 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.851810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.851927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.852139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.852241 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.852463 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.852561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.852780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.852881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.853092 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.853188 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.853404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.853506 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.853725 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:47:31.853821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.854032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.854124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.854355 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.854493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.854661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.854755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.854995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.855105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.855318 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.855422 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.855630 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.855726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.855935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.856040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.856239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.856343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.856561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.856658 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.856866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.856961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.857189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.857292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.857505 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.857607 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.857829 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.857923 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.858153 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.858249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.858461 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.858568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.858812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.858978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.859152 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.859249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.859472 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.859566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.859798 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.859899 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.860116 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.860221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.860443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.860587 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.860781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.860888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.861106 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.861203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.861421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.861522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.861756 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.861926 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.862071 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.862167 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.862405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.862558 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.862734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.862841 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.863082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.863190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.863397 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.863492 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.863711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.863818 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.864027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.864125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.864334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.864428 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.864642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.864738 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.864956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.865051 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.865271 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.865374 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.865580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.865676 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.865888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.865983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.866198 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.866300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.866504 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.866601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.866811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.866937 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.867140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.867237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.867463 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.867559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.867768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.867872 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.868092 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.868199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.868402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.868498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.868710 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.868805 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.869017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.869190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.869322 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.869425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.869665 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.869769 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.869969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.870077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.870299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.870392 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.870609 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.870709 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.870949 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.871065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.871250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.871355 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.871566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.871666 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.871875 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.871983 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.872189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.872290 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.872506 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.872639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.872823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.872920 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.873140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.873242 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.873453 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.873548 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.873766 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.873860 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.874080 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.874657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.874899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.875061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.875287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.875617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.875739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.875935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.876087 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.876245 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.876352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.876575 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.876670 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.876891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.876994 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.877204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.877299 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.877520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.877623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.877831 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.877924 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.878143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.878240 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.878455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.878555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.878769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.878866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.879110 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.879205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.879431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.879527 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.879749 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.879857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.880078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.880173 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.880396 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.880492 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.880713 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.880816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.881029 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.881129 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.881348 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.881450 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.881675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.881797 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.882009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.882111 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.882317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.882412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.882632 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.882772 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.882961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.883060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.883279 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.883381 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.883589 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.883683 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.883901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.883996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.884210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.884305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.884526 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.884629 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.884835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.884974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.885144 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.885250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.885451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.885540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.885762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.885857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.886073 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.886220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.886402 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.886497 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.886717 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.886819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.887048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.887162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.887361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.887465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.887672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.887776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.888022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.888187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.888336 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.888503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.888684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.888838 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.889027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.889164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.889353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.889490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.889682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.889831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.890553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.890688 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.890879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.891109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.891217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.891499 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.891605 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.891816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.891919 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.892131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.892233 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.892446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.892551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.892753 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.892889 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.893076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.893177 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.893385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.893487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.893693 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.893789 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.894015 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.894114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.894325 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.894427 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.894647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.894859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.894994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.895238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.895344 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.895555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.895671 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.895891 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.895993 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.896220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.896334 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.896540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.896642 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.896850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.896945 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.897177 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.897280 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.897486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.897582 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.897795 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.897897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.898115 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.898210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.898430 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.898524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.898738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.898832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.899074 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.899188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.899388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.899483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.899699 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.899796 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.900006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.900102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.900316 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.900411 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.900625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.900734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.900953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.901056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.901260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.901356 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.901566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.901669 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.901871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.901975 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.902183 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.902278 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.902489 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.902597 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.902795 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.902890 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.903127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.903258 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.903432 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.903580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.903746 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.903842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.904049 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.904150 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.904399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.904494 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.904720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.904823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.905036 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.905165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.905350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.905461 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.905725 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.905911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.906048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.906231 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.906413 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.906555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.906651 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.906863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.906986 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.907195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.907307 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.907514 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.907608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.907827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.907922 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.908151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.908255 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.908465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.908560 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.908776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.908871 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.909116 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.909210 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.909435 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.909536 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.909748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.909973 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.910083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.910311 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.910407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.910633 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.910742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.910995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.911145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.911317 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.911420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.911627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.911733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.911933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.912034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.912243 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.912375 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.912565 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.912676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.912876 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.912970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.913189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.913283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.913501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.913608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.913815 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.913917 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.914127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.914230 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.914436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.914535 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.914749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.914842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.915090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.915186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.915404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.915499 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.915719 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.915823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.916034 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.916136 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.916348 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.916493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.916660 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.916764 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.916973 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.917082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.917280 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.917374 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.917600 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.917697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.917923 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.918027 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.918243 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.918498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.918601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.918846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.918988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.919195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.919290 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.919507 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.919605 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.919816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.919913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.920126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.920232 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.920444 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.920635 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.920774 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.920872 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.921123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.921285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.921424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.921569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.921836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.921936 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.922152 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.922248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.922474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.922589 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.922796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.922899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.923134 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.923229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.923456 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.923561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.923780 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.923876 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.924094 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.924188 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.924406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.924509 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.924718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.924826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.925284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.925379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.925675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.925825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.925961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.926063 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.926241 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.926394 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.926566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.926716 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.926882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.927056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.927210 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.927526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.927650 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.927847 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.927971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.928156 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.928286 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.928459 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.928582 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.928762 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.928885 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.929073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.929203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.929378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.929509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.929684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.929808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.929989 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.930126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.930292 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.930426 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.930600 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.930723 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.930901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.931055 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.931491 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.931823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.932136 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.932277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.932453 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.932603 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.932766 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.932878 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.933113 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.933222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.933428 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.933540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.933750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.933846 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.934068 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.934172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.934384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.934481 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.934696 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.934799 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.935028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.935141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.935348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.935483 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.935658 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.935763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.935979 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.936082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.936296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.936394 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.936606 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.937222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.937468 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.937561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.937785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.937890 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.938101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.938274 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.938412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.938606 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.938728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.938936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.939063 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.939263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.939388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.939617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.939722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.939957 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.940248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.940343 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.940567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.940712 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.940884 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.940978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.941198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.941350 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.941509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.941623 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.941821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.941951 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.942153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.942257 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.942466 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.942570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.942773 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.942867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.943114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.943222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.943428 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.943521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.943738 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.943833 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.944054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.944191 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.944370 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.944467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.944689 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.944827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.944999 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.945105 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.945310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.945412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.945615 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.945709 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.945927 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.946037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.946236 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.946340 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.946548 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.946643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.946855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.946988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.947188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.947284 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.947495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.947592 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.947802 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.947900 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.948109 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.948213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.948437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.948540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.948748 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.948842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.949054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.949148 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.949365 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.949460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.949673 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.949769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.950019 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.950115 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.950328 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.950422 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.950674 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.950768 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.951018 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.951133 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.951333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.951508 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.951642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.951751 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.951888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 03:47:31.952446 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.953268 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.953632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.953910 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.954261 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.954582 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.954941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.955257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.955573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.955904 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.956225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.956544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.956874 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.957204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.957533 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.957845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.958159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.958476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.958840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.959349 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.959670 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.959991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.960312 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.960632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.960951 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.961267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.961638 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.961918 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.962236 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.962549 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.962880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.963220 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.963547 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.963864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.964174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.964494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.964807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.965249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.965568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.965887 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.966199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.966516 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.966835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.967186 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.967510 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.967825 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.968407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.968727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.969049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.969369 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.969681 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.969995 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.970315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.970648 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.970984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.971299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.971613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.971951 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.972260 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.972590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.973016 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.973334 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.973646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.974070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.974388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.974704 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.975056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.975386 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.975716 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.976028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.976346 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.976663 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.976994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.977324 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.977642 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.977966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.978281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.978612 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.978969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.979294 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.979624 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.980046 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.980377 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.980697 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.981027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.981359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.981677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.981988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.982304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.982616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.982946 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.983281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.984161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.984496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.984817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.985134 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.985446 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.985758 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.986087 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.986399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.986728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.987073 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.987404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.987733 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.988045 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.988373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.988691 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.989004 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.989315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.989650 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.990004 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.990327 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.990655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.991017 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.991378 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.991698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.992039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.992378 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.992706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.993024 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.993347 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.993677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.993988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.994300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.994616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.994943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.995262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.995574 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.995888 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.996195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.996506 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.996815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.997145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.997452 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.997807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.998117 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.998424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.998758 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.999215 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.999612 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:31.999927 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.000267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.000586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.000916 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.001243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.001595 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.001925 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.002272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.002595 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.002991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.003311 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.003633 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.003957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.004281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.004606 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.005175 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.005532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.005884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.006214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.006531 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.006877 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.007225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.007568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.007887 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.008225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.008555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.008892 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.009239 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.009574 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.009932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.010272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.010596 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.010945 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.011261 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.011624 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.011945 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.012265 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.012586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.012912 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.013231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.013550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.013671 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Registered counter for database nova_api Sep 16 03:47:32.013872 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.014194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.014517 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.015384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.015703 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.016025 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.016350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.016681 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.017021 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.017347 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.017668 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.017988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.018352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.018838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.019187 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.019527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.019861 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.020192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.020512 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.020836 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.021168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.021478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.021788 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.022105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.022419 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.022734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.023083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.023400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.023711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.024036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.024353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.024895 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.025250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.025573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.025906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.026237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.026560 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.026874 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.027228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.027542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.027854 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.028176 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.028494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.028805 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.029119 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.029523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.029842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.030156 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.030574 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.030836 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.031783 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.031783 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.032130 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.032130 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.032450 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.032728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.033040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.033354 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.033664 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.033983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.034292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.034714 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.036031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.036031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.036031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.036277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:47:32.036382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.036382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.036644 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.036953 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.037262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.037590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.037905 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.038234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.038551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.038869 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.039368 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.039691 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.040282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.040628 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.041246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.041608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.041950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.042267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.042587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.042901 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.043254 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.043426 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:47:32.043590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.043880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.044197 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.044515 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.044832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.045148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.045464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.045780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.046635 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.047009 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.047330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.047773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.048098 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.048417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.048739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.049087 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.049414 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.049740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.050326 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.050649 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.050990 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.051307 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.051622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.051935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.052257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.052595 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.052913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.053224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.053655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.053973 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.054297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.054623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.054957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.055289 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.055616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.055932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.056259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.056575 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.056911 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.057255 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.057590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.057920 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.058231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.058542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.058851 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.059191 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.059516 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.059833 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.060143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.060452 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.060757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.061091 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.061402 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.061796 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.062342 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.062649 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.062990 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.063543 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.063862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.064178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.064495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.064808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.065126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.065438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.065755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.066067 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.066380 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.066691 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.067065 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.067472 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.067729 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.068057 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.068375 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.068704 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.069019 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.069347 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.069675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.070001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.070321 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.070660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.071007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.071330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.071652 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.071971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.072287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.072602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.072943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.073274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.073587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.073918 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.074241 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.074569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.074890 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.075229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.075563 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.075880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.076196 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.076509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.076827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.077143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.078009 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.078477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.078801 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.079152 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.079476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.079810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.080143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.080459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.080794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.081125 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.081478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.081798 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.082150 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.082484 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.082804 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.083147 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.083466 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:47:32.083715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 03:47:32.106868 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.context [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),035a2354-99fe-448b-a23d-f019d795a350(cell1) {{(pid=127618) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 03:47:32.111624 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:47:32.112102 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:47:32.113758 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:47:32.114602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:47:32.114970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:47:32.117029 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:47:32.119208 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Registered counter for database nova_cell0 Sep 16 03:47:32.124040 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Registered counter for database nova_cell1 Sep 16 03:47:32.132691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:47:32.136638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:47:32.137285 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:47:32.146699 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Registered counter for database nova_api Sep 16 03:47:32.168132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:47:32.175460 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:47:32.232106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.context [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),035a2354-99fe-448b-a23d-f019d795a350(cell1) {{(pid=127617) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 03:47:32.236887 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:47:32.237369 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:47:32.239010 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:47:32.239747 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:47:32.240204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:47:32.242240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:47:32.244560 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Registered counter for database nova_cell0 Sep 16 03:47:32.248716 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Registered counter for database nova_cell1 Sep 16 03:47:32.259972 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:47:32.260941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:47:32.269160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:47:32.270382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:47:32.293801 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:47:32.304775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Registered counter for database nova_cell0 Sep 16 03:47:32.315488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:47:32.320213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:47:32.426578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Registered counter for database nova_cell0 Sep 16 03:47:32.435359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:47:32.441223 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:47:32.657700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 03:47:32.665044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 03:47:32.778827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 03:47:32.786786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 03:47:33.010319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 03:47:33.017556 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-50bf5056-ee85-4c73-8028-d36bca4d6a5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 03:47:33.023096 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b47c3649c0 pid: 127618 (default app) Sep 16 03:47:33.155867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 03:47:33.161851 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-8025c8b2-b86a-4883-8ffd-13a9b0590cfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 03:47:33.167158 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b47c3649c0 pid: 127617 (default app) Sep 16 03:48:09.600537 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:09.603538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:09.603538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:09.603538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:10.833095 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-82feee10-9d29-43bc-a5d7-4c6b83a7f583 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Action: 'create', calling method: .version_select at 0x7fba7d6b94c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-300442194", "metadata": {"Type": "work"}}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:13.379913 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-82feee10-9d29-43bc-a5d7-4c6b83a7f583 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.784445 Sep 16 03:48:13.389719 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Sep 16 03:48:09 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3787 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 16 03:48:13.911545 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-510d4527-8049-4d8c-b96c-7ded60f6d58f tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Calling method '.version_select at 0x7fba7d767f70>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:13.975983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:13.976991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:13.977939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:13.978985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:14.470855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-510d4527-8049-4d8c-b96c-7ded60f6d58f tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d" status: 200 len: 352 microversion: 2.1 time: 1.067205 Sep 16 03:48:14.472814 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:48:13 2022] GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d => generated 352 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:15.487852 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-564c9c09-c9c7-465e-bdbb-77b512dd3e3b tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Calling method '.version_select at 0x7fba7d58e3a0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:15.619895 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-564c9c09-c9c7-465e-bdbb-77b512dd3e3b tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d" status: 200 len: 353 microversion: 2.1 time: 0.129063 Sep 16 03:48:15.619895 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:48:15 2022] GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:15.629317 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f38d2c5-2fe5-4320-a639-60b0b6c7db6f tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Calling method '.version_select at 0x7fba7d57a430>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:15.714233 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f38d2c5-2fe5-4320-a639-60b0b6c7db6f tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d" status: 200 len: 353 microversion: 2.1 time: 0.092922 Sep 16 03:48:15.714803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:48:15 2022] GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:15.735452 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5e300059-ed5d-4d15-8bcf-6acce7b737a8 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Calling method '.version_select at 0x7fba7d58ea60>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:16.090530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5e300059-ed5d-4d15-8bcf-6acce7b737a8 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d" status: 202 len: 0 microversion: 2.1 time: 0.359854 Sep 16 03:48:16.091118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:48:15 2022] DELETE /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:48:16.099896 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3e20e1bc-abf2-4601-b6d1-43fd2b15ccd9 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Calling method '.version_select at 0x7fba7d57aa60>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:16.182539 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3e20e1bc-abf2-4601-b6d1-43fd2b15ccd9 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d" status: 200 len: 352 microversion: 2.1 time: 0.086233 Sep 16 03:48:16.183151 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:48:16 2022] GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:17.202344 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-418e56ba-cd3f-45c9-908f-a1e2f20cc7c9 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Calling method '.version_select at 0x7fba7d529160>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:17.261597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-418e56ba-cd3f-45c9-908f-a1e2f20cc7c9 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] HTTP exception thrown: Volume 18814071-0eca-4919-9d16-04cb299c0c2d could not be found. Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-418e56ba-cd3f-45c9-908f-a1e2f20cc7c9 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Request method failure captured: Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d HTTP/1.1 Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_H59ZyhJQdNOBCXTEIfWM3GWe-xhZ22LddFASO21nGGHzR3YX-F2ayyUvhCMd54mg1JQ7CQj4PUdpFz7TJp_g-9gFooP05nyX9jzaqqUsry5YEzgqyUImwoHdcpHBm-yjrlGMzBG6HUHQt2EpF0eZjPMpOwEqXsk5b_Pm8RQFq5zyU Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: ef5d958ed6b74751b951c2fb90804692 Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesGetTestJSON-204144125 Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:48:17.269809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef5d958ed6b74751b951c2fb90804692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ef5d958ed6b74751b951c2fb90804692"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ef5d958ed6b74751b951c2fb90804692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef5d958ed6b74751b951c2fb90804692"}]}] Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesGetTestJSON-204144125 Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: ef5d958ed6b74751b951c2fb90804692 Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesGetTestJSON-204144125 Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesGetTestJSON-204144125-project Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: e368482ff3834c0fa4a5579e29ae586e Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesGetTestJSON-204144125-project Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Volume 18814071-0eca-4919-9d16-04cb299c0c2d could not be found. Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '18814071-0eca-4919-9d16-04cb299c0c2d'} Sep 16 03:48:17.271220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18814071-0eca-4919-9d16-04cb299c0c2d could not be found. (HTTP 404) (Request-ID: req-bb4381c8-d3e3-412e-b7cf-fcf81875dc04) Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:48:17.272129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:48:17.273361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18814071-0eca-4919-9d16-04cb299c0c2d could not be found. Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 03:48:17.274836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18814071-0eca-4919-9d16-04cb299c0c2d could not be found. Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18814071-0eca-4919-9d16-04cb299c0c2d could not be found. Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-418e56ba-cd3f-45c9-908f-a1e2f20cc7c9 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] Returning 404 to user: Volume 18814071-0eca-4919-9d16-04cb299c0c2d could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-418e56ba-cd3f-45c9-908f-a1e2f20cc7c9 tempest-VolumesGetTestJSON-204144125 tempest-VolumesGetTestJSON-204144125-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d" status: 404 len: 109 microversion: 2.1 time: 0.078099 Sep 16 03:48:17.275995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:48:17 2022] GET /compute/v2.1/os-volumes/18814071-0eca-4919-9d16-04cb299c0c2d => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:48:23.023207 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9503397f-cfed-4a6a-9d98-6d76850f1e69 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'create', calling method: .version_select at 0x7fba7d58b0d0>, body: {"keypair": {"name": "tempest-keypair-1085684248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx4ihdWhhXimNAvBN0EmP0UXnEzrqsYb4q8u2S0VluigRGDPKicEA/vveSeWcWNoM7ABux+87HaqBJvEX+nrDm7wmrWeIBaPFPd2VrPCbzzasIYuiRUxY5liTzNFh7pTw=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:23.223976 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-9503397f-cfed-4a6a-9d98-6d76850f1e69 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Getting quotas for project e94b50976295422c9c8374155cf2d2c2. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:23.253542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-9503397f-cfed-4a6a-9d98-6d76850f1e69 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Getting quotas for user 8f410d691e364880b13bb9144bbc5e7d and project e94b50976295422c9c8374155cf2d2c2. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:23.480323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9503397f-cfed-4a6a-9d98-6d76850f1e69 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.195315 Sep 16 03:48:23.481507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 4/8] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:48:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:29.195492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-360349007", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "networks": [{"uuid": "d8d0986c-f45f-4403-8f11-6637eeae0fb2"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:29.415131 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1c10ff54-9518-4d16-b0b8-df8cd2d580dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: .version_select at 0x7fba7d4fd1f0>, body: {"keypair": {"name": "tempest-keypair-1869310059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDEuCaRCeS0esNSSmFXBsLT94+Weuc7iCb2bW9oooW+13L7RDkDoca4HJlO65XmD8Cpg4GidKm1+7Elg6UToqHMaVlrcKievO3w0nI17cIJRn0fzdJjzCHHMOeUn8RjXA=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:29.463809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-1c10ff54-9518-4d16-b0b8-df8cd2d580dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:29.495085 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-1c10ff54-9518-4d16-b0b8-df8cd2d580dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for user ff7df9be8475405eba924b59a7bd6bb0 and project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:29.519492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] validate_networks() for [('d8d0986c-f45f-4403-8f11-6637eeae0fb2', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:48:29.676246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1c10ff54-9518-4d16-b0b8-df8cd2d580dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.830089 Sep 16 03:48:29.677141 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 5/9] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:48:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:30.357384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5b3be61f-c0df-4a22-8982-33b8ed82c056 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'create', calling method: .version_select at 0x7fba7d4a7280>, body: {"keypair": {"name": "tempest-keypair-229780924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlmyql4LlK/vELLkZdfmcmMoVQv6H6YoxT5BDXH2HAoO+hzQlCwlJneuXSp8BHlh8e4fIYbcLYrtoakKyj5K91KQKowb1mvUTOdOMM8f0+gHMUK6c6fumV6tofjzJGD/w=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:30.406660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-5b3be61f-c0df-4a22-8982-33b8ed82c056 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Getting quotas for project cb698ddcedae42a29f50203ec59db295. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:30.412092 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-5b3be61f-c0df-4a22-8982-33b8ed82c056 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Getting quotas for user 416479ba056f4612b6214cf115251269 and project cb698ddcedae42a29f50203ec59db295. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:30.534732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5b3be61f-c0df-4a22-8982-33b8ed82c056 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.448988 Sep 16 03:48:30.535542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 6/10] 10.222.0.49 () {62 vars in 1200 bytes} [Fri Sep 16 03:48:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 452 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 03:48:32.614056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-434619369", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96000232-5a2c-4cbe-8524-4ab75044ef77"}], "security_groups": [{"name": "tempest-securitygroup--1258045977"}], "key_name": "tempest-keypair-1085684248", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:32.646031 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:48:32.646561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:48:32.647087 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:48:32.647503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:48:32.647913 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:48:32.682520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:32.683574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:32.684156 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:32.685845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:32.686704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:32.687421 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:32.739389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Getting quotas for project d39c13d4012549c2890bf1d904d1c041. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:32.750214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Getting quotas for user c1e4846769d44451b239dee5c892b5e8 and project d39c13d4012549c2890bf1d904d1c041. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:32.769127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:48:32.773732 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:48:33.069013 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-90bba457-2bc5-4514-b821-3236ac66b5ae tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.404386 Sep 16 03:48:33.081150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 5/11] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:48:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:48:33.116577 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eef2d714-9c67-4521-80ba-24906bdcf83e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:33.117503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-eef2d714-9c67-4521-80ba-24906bdcf83e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:33.141177 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] validate_networks() for [('96000232-5a2c-4cbe-8524-4ab75044ef77', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:48:33.292778 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eef2d714-9c67-4521-80ba-24906bdcf83e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:33.372946 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eef2d714-9c67-4521-80ba-24906bdcf83e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1214 microversion: 2.1 time: 0.260197 Sep 16 03:48:33.377620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:33 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:34.259008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1395128068", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:34.385738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] validate_networks() for [('64754a20-d60c-49a4-9c39-1462c6265039', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:48:35.776249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:48:35.777386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:48:35.778781 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:48:35.779285 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:48:35.779981 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:48:35.803454 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:35.807090 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:35.811901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:35.812844 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:35.813407 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:35.813855 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:35.836039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Getting quotas for project ac97d1487c024a68b8ad933d882bb456. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:35.840441 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Getting quotas for user a6b29b9086f64ea7a7990572567642f7 and project ac97d1487c024a68b8ad933d882bb456. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:35.851956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:48:35.854170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:48:35.910562 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:48:35.911105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:48:35.911639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:48:35.912121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:48:35.912618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:48:35.921722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:35.922307 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:35.922812 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:35.923633 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:35.924172 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:35.924667 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:35.948493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Getting quotas for project e94b50976295422c9c8374155cf2d2c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:35.953444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Getting quotas for user 8f410d691e364880b13bb9144bbc5e7d and project e94b50976295422c9c8374155cf2d2c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:35.964760 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:48:35.967639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:48:37.262205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c6c94352-acf4-48d1-9b41-b41100dd5393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.498854 Sep 16 03:48:37.270028 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 7/13] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:48:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 3502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 03:48:37.274889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6f4d82fa-2aee-4597-97fc-804cbd3ac246 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:37.275552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6f4d82fa-2aee-4597-97fc-804cbd3ac246 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:37.352135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-851c14ab-1261-479c-98ea-d237dfdb19e7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.742061 Sep 16 03:48:37.363858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 7/14] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:48:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 4758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 03:48:37.431537 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a4d4fc1b-7551-48ca-b237-b838454157ef tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:37.433249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a4d4fc1b-7551-48ca-b237-b838454157ef tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:37.618277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f4d82fa-2aee-4597-97fc-804cbd3ac246 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:37.644497 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6f4d82fa-2aee-4597-97fc-804cbd3ac246 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1214 microversion: 2.1 time: 0.378747 Sep 16 03:48:37.645106 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:37 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:37.660724 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50d5ecbf-1bea-42ce-85b5-ffc536091ba7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:37.664192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-50d5ecbf-1bea-42ce-85b5-ffc536091ba7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:37.832645 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4d4fc1b-7551-48ca-b237-b838454157ef tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:37.838939 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-50d5ecbf-1bea-42ce-85b5-ffc536091ba7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:37.856476 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-50d5ecbf-1bea-42ce-85b5-ffc536091ba7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1237 microversion: 2.1 time: 0.208647 Sep 16 03:48:37.866779 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a4d4fc1b-7551-48ca-b237-b838454157ef tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1222 microversion: 2.1 time: 0.490862 Sep 16 03:48:37.867126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 9/16] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:37 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1237 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:37.867213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 8/17] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:37 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1222 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:38.009028 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-555850466", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ff8c520-12d3-47e5-b499-6dbd6e9a131a"}], "security_groups": [{"name": "tempest-securitygroup--924061213"}], "key_name": "tempest-keypair-1869310059", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:38.253076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1454733029", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:38.365171 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] validate_networks() for [('64754a20-d60c-49a4-9c39-1462c6265039', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:48:38.429791 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] validate_networks() for [('4ff8c520-12d3-47e5-b499-6dbd6e9a131a', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:48:39.556020 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:48:39.556573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:48:39.556921 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:48:39.557488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:48:39.558250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:48:39.579374 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:39.580219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:39.580873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:39.581764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:39.582386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:39.583015 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:39.615728 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:39.620570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for user ff7df9be8475405eba924b59a7bd6bb0 and project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:39.642404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:48:39.646126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:48:39.759202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:48:39.759202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:48:39.759202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:48:39.759202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:48:39.759202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:48:39.776192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:39.777361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:39.778016 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:39.778807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:39.779965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:39.781284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:39.808341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Getting quotas for project ac97d1487c024a68b8ad933d882bb456. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:39.813395 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Getting quotas for user a6b29b9086f64ea7a7990572567642f7 and project ac97d1487c024a68b8ad933d882bb456. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:39.825104 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:48:39.840575 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:48:39.905508 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3d514a3a-1711-43ef-bef0-943c0104d3d0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.904749 Sep 16 03:48:39.913050 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 10/18] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:48:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:48:39.926881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:39.929883 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:39.948700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:39.950138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:39.950648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:39.952746 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:39.953436 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:39.954742 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:40.103356 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1a72aba8-74d7-4d1a-9ff6-54279baf6ada tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.854903 Sep 16 03:48:40.114958 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 9/19] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:48:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:48:40.126126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:40.128020 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:40.150060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:40.150060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:40.150060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:40.150060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:40.150529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:40.150529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:40.407768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:40.430720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2877dcf4-a4cc-446a-98be-155569658086 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1210 microversion: 2.1 time: 0.513923 Sep 16 03:48:40.441393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 11/20] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:39 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1210 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:40.462267 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-938836020", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60a25330-2068-4171-85ea-2cd82f09cbdb"}], "security_groups": [{"name": "tempest-securitygroup--1256955267"}], "key_name": "tempest-keypair-229780924", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:40.481862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:40.518590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2ae909c0-0106-4b3d-9361-122346ff7745 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1241 microversion: 2.1 time: 0.403618 Sep 16 03:48:40.519227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 10/21] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:40 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1241 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:40.550041 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f7fd5c1-3809-4ea6-adc1-cd49832ce3bd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:40.552109 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f7fd5c1-3809-4ea6-adc1-cd49832ce3bd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:40.679967 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] validate_networks() for [('60a25330-2068-4171-85ea-2cd82f09cbdb', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:48:40.842978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f7fd5c1-3809-4ea6-adc1-cd49832ce3bd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:40.846854 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f7fd5c1-3809-4ea6-adc1-cd49832ce3bd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1241 microversion: 2.1 time: 0.326564 Sep 16 03:48:40.847481 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 11/22] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:40 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1241 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:40.862939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f3b95ed5-2054-4bc8-92f1-a57008cb3eec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:40.865932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f3b95ed5-2054-4bc8-92f1-a57008cb3eec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:40.973292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f3b95ed5-2054-4bc8-92f1-a57008cb3eec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:40.980914 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f3b95ed5-2054-4bc8-92f1-a57008cb3eec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1222 microversion: 2.1 time: 0.128540 Sep 16 03:48:40.981725 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:40 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:41.414369 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:48:41.415598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:48:41.420885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:48:41.420885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:48:41.420885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:48:41.440252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:41.444201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:41.444201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:41.444201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:41.449306 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:41.450283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:41.463544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:41.468356 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:41.488912 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:41.497887 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:41.498628 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:41.499567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:41.500231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:41.505636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:41.505784 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Getting quotas for project cb698ddcedae42a29f50203ec59db295. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:48:41.509764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Getting quotas for user 416479ba056f4612b6214cf115251269 and project cb698ddcedae42a29f50203ec59db295. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:48:41.531180 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:48:41.535515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:48:41.661026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:41.669478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6de1fc80-ffea-4b4e-bc4b-40375426508e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1266 microversion: 2.1 time: 0.211851 Sep 16 03:48:41.691719 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 13/24] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:41 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:41.697798 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:41.698425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:41.705590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:41.706383 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:41.707131 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:41.708063 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:41.708730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:41.709423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:41.750743 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e55dda08-2e81-4ac3-8334-eda313d74d8c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.317523 Sep 16 03:48:41.752513 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 12/25] 10.222.0.49 () {62 vars in 1188 bytes} [Fri Sep 16 03:48:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 03:48:41.768151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-63f30ffe-8f20-438d-8fd5-4d7ed4a44e39 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:41.776298 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-63f30ffe-8f20-438d-8fd5-4d7ed4a44e39 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:41.941442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63f30ffe-8f20-438d-8fd5-4d7ed4a44e39 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:41.949602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63f30ffe-8f20-438d-8fd5-4d7ed4a44e39 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:41.951116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63f30ffe-8f20-438d-8fd5-4d7ed4a44e39 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:41.952284 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-63f30ffe-8f20-438d-8fd5-4d7ed4a44e39 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1280 microversion: 2.20 time: 0.188591 Sep 16 03:48:41.978460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 13/26] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:41 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:41.986721 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a76c3f80-8a39-413e-be5e-bae108f1279f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:41.991586 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a76c3f80-8a39-413e-be5e-bae108f1279f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:42.104968 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:42.120642 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f6842dc9-6c7f-4fad-ae5e-a0b6f59df302 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1233 microversion: 2.1 time: 0.423795 Sep 16 03:48:42.126243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 14/27] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:41 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1233 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:42.141081 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a76c3f80-8a39-413e-be5e-bae108f1279f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:42.148242 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:42.148869 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:42.155076 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a76c3f80-8a39-413e-be5e-bae108f1279f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1241 microversion: 2.1 time: 0.174767 Sep 16 03:48:42.157141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 14/28] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:41 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:42.177942 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:42.178641 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:42.179288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:42.180161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:42.181057 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:42.181496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:42.295976 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:42.323786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e9de857c-f234-43a9-b18a-2cacce3f308d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1226 microversion: 2.1 time: 0.196092 Sep 16 03:48:42.334933 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 15/29] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:42 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:42.695106 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:42.695722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:42.703108 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:42.706566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:42.706566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:42.706566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:42.706566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:42.706994 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:42.819991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:42.836036 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f679093c-2bd5-4c01-995a-b71e1ea32a9c tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1272 microversion: 2.1 time: 0.144429 Sep 16 03:48:42.838157 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:42 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:42.980023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-125ac4b7-106c-4be4-ba8a-de0494e0cd9b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:42.980920 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-125ac4b7-106c-4be4-ba8a-de0494e0cd9b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:43.154407 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:43.155638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:43.185075 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:43.186220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:43.186669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:43.187566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:43.191139 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:43.191843 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:43.358280 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:43.369132 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a1284953-9b7a-4465-a413-452371555819 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1289 microversion: 2.1 time: 0.220156 Sep 16 03:48:43.389647 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:43 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1289 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:43.413723 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:43.413723 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:43.432829 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:43.433596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:43.436677 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:43.437717 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:43.443916 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:43.444623 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:43.672759 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:43.682486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-14d2c7b8-0a0d-4ea9-9062-618487bc1495 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1237 microversion: 2.1 time: 0.288060 Sep 16 03:48:43.683121 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 17/32] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:43 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1237 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:43.721768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:43.722289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:43.741193 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:43.745604 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:43.745604 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:43.748931 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:43.749495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:43.750035 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:43.767139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-125ac4b7-106c-4be4-ba8a-de0494e0cd9b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:43.780436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-125ac4b7-106c-4be4-ba8a-de0494e0cd9b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:43.786806 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-125ac4b7-106c-4be4-ba8a-de0494e0cd9b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:43.800591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-125ac4b7-106c-4be4-ba8a-de0494e0cd9b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1280 microversion: 2.20 time: 0.821246 Sep 16 03:48:43.806066 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 16/33] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:42 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1280 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:43.865969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:43.876849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:43.879168 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:43.894285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:43.895099 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:43.895973 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:43.897297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:43.898095 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:43.899148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:43.908838 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-12031733-7042-4961-8a2e-aa7c3144ca80 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1218 microversion: 2.1 time: 0.214685 Sep 16 03:48:43.910133 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 18/34] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:43 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1218 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:44.397882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:44.398619 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:44.409261 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:44.422225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:44.423872 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:44.424404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:44.425222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:44.425881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:44.426662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:44.505817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:44.525532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-abba8cea-bfb8-4b94-ad4f-2b904d7c5dbb tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.666277 Sep 16 03:48:44.526140 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 17/35] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:43 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:44.538526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:44.553323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-64b12c36-825b-4915-a6bf-b5c150fa9fa2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1295 microversion: 2.1 time: 0.159096 Sep 16 03:48:44.554469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 19/36] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:44 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1295 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:44.711353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:44.714755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:44.732159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:44.740155 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:44.744066 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:44.748971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:44.748971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:44.759000 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:44.835211 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:44.836577 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:44.861968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:44.867005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:44.872019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:44.874022 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:44.878260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:44.888503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:44.984306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:44.995132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-47f66ea9-8d0a-4b86-8db1-adc06bae1e52 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1237 microversion: 2.1 time: 0.286561 Sep 16 03:48:44.995132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 18/37] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:44 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1237 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:45.020081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:45.020081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:45.027126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:45.043008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:45.043969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:45.044815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:45.046306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:45.048485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:45.049110 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:45.075840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:45.098735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:45.106424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:45.110310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ca9bee5-b4e4-4339-a7c5-7d2d5e59597e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1276 microversion: 2.20 time: 0.282656 Sep 16 03:48:45.113400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 20/38] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:44 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1276 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:48:45.287796 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:45.319583 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9a803920-99db-47e6-8364-d786f184b725 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1274 microversion: 2.1 time: 0.317497 Sep 16 03:48:45.331911 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 19/39] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:44 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1274 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:45.548402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:45.549332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:45.556692 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:45.557501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:45.558254 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:45.559213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:45.559901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:45.561149 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:45.591658 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:45.593999 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:45.612968 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:45.613791 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:45.614379 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:45.615306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:45.616059 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:45.617318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:45.856160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:45.856957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9032ed89-aeb7-4099-a0b0-482fc22e1cef tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1295 microversion: 2.1 time: 0.276811 Sep 16 03:48:45.859658 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 20/40] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:45 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1295 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:45.913051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:45.921733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-41800118-998c-4226-9e6a-118960a9de06 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.377148 Sep 16 03:48:45.931853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 21/41] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:45 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:46.022534 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:46.024039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:46.032938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.039809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.039809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.039809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.039809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.040108 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.142774 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:46.143484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:46.159793 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.160569 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.161228 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.162736 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.166343 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.167486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.304033 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:46.334154 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1b79768a-5b98-4ac1-b77f-6a0182a34cd3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1237 microversion: 2.1 time: 0.308141 Sep 16 03:48:46.346933 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 21/42] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:46 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1237 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:46.359647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:46.366330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:46.379754 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.380249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.380702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.384424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.384921 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.385418 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.480876 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:46.498484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:46.507448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:46.507448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-35b4cf72-5edd-479b-abc8-6d7f7a7fdc79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1276 microversion: 2.20 time: 0.368137 Sep 16 03:48:46.507448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 22/43] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:46 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1276 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:48:46.667780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:46.676956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-510cd23f-0406-4fa9-b58b-ec2501482446 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1274 microversion: 2.1 time: 0.336181 Sep 16 03:48:46.701624 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 22/44] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:46 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1274 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:46.901754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:46.901754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:46.901754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.901754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.902661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.902661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.902661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.902661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.975339 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:46.978248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:46.993437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.995084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.999166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:46.999166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:46.999166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:46.999166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:47.338997 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:47.357965 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e0e7a334-55ba-4e3a-af1e-f023b7af48de tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.475055 Sep 16 03:48:47.359251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 23/45] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:46 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:47.365422 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:47.366225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:47.375524 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:47.376052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:47.376503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:47.377228 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:47.379970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:47.380888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:47.501254 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:47.513419 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3f1f7a01-3242-495c-a16d-6b88d4ac8d1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1293 microversion: 2.1 time: 0.152871 Sep 16 03:48:47.519432 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 24/46] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:47 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:47.539432 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:47.540343 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:47.553190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:47.553956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:47.555021 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:47.556429 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:47.557045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:47.557711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:47.661544 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:47.667408 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:47.669682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:47.671841 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4c5414ba-4846-4e58-bc2c-0fc6bcd7adce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1276 microversion: 2.20 time: 0.146225 Sep 16 03:48:47.697215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 25/47] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:47 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:48:47.728181 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:47.729927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:47.763406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:47.764582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:47.765027 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:47.766779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:47.767276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:47.767779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:47.937852 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:48.044693 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fc6885e6-1037-4cb0-a411-d73e13de97be tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.996834 Sep 16 03:48:48.044693 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:46 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:48.046889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:48.046889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8157a784-c0e1-48c5-b23f-413bf867741b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1280 microversion: 2.1 time: 0.326949 Sep 16 03:48:48.046889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 26/49] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:47 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1280 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:48.382869 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:48.383686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:48.392094 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:48.392579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:48.393673 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:48.394375 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:48.394823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:48.395267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:48.547737 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:48.549158 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:48.577118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:48.579731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:48.581410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:48.585402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:48.586097 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:48.589475 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:48.838358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:48.859480 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d3956416-1d66-401b-b352-1a3bd5fd9de1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1293 microversion: 2.1 time: 0.315729 Sep 16 03:48:48.864290 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 27/50] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:48 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1293 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:48.903039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:48.905306 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:48.930242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:48.930818 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:48.940443 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:48.941500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:48.946528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:48.954102 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:49.360518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:49.377372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:49.379783 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:49.381975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d929b95d-d643-43db-99d7-c60f1157586e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1276 microversion: 2.20 time: 0.516408 Sep 16 03:48:49.383529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 28/51] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:48 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1276 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:49.465604 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-9ddb6629-c50b-462e-b9e6-636dc7acb06f req-6925b9df-07df-4a97-9c62-a27f10e5275d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234c7287-59d4-425c-ba2b-56031d311ee6", "tag": "19b4f355-bc74-46bb-9c3e-debddf171414"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:49.498589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9ddb6629-c50b-462e-b9e6-636dc7acb06f req-6925b9df-07df-4a97-9c62-a27f10e5275d service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:49.499507 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9ddb6629-c50b-462e-b9e6-636dc7acb06f req-6925b9df-07df-4a97-9c62-a27f10e5275d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:49.500124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9ddb6629-c50b-462e-b9e6-636dc7acb06f req-6925b9df-07df-4a97-9c62-a27f10e5275d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:49.523959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:49.534571 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-9ddb6629-c50b-462e-b9e6-636dc7acb06f req-6925b9df-07df-4a97-9c62-a27f10e5275d service nova] Creating event network-changed:19b4f355-bc74-46bb-9c3e-debddf171414 for instance 234c7287-59d4-425c-ba2b-56031d311ee6 on hv-cinder-85799 Sep 16 03:48:49.535401 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9ddb6629-c50b-462e-b9e6-636dc7acb06f req-6925b9df-07df-4a97-9c62-a27f10e5275d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 03:48:49.536289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9ddb6629-c50b-462e-b9e6-636dc7acb06f req-6925b9df-07df-4a97-9c62-a27f10e5275d service nova] Acquired lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 03:48:49.537548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:49.538186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:49.538783 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:49.540700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:49.541669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:49.542255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:49.561375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.compute.rpcapi [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 03:48:49.563222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] Releasing lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 03:48:49.584050 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-669e14ea-0615-4c9f-a475-37b017b037e3 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199055 Sep 16 03:48:49.585296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 29/52] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:49.591041 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:49.593012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:49.601166 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:49.602719 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:49.603521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:49.609314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:49.609314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:49.609314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:49.786328 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:49.792274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:49.795456 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3a93617a-ff16-41ca-b3f3-4f259cdaf8b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 1.416502 Sep 16 03:48:49.797771 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 24/53] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:48 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:49.811753 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:49.812629 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:49.835087 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:49.836032 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:49.836793 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:49.837676 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:49.838210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:49.838844 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.044127 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:50.061141 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c8f80797-97ee-4df2-a0b1-87c761c7950b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1280 microversion: 2.1 time: 0.262672 Sep 16 03:48:50.075780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 25/54] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:49 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:50.400599 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:50.411854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d6e01344-bd1c-410c-b178-58954b7c2bd5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.825022 Sep 16 03:48:50.415811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 30/55] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:49 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:50.421452 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:50.430411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:50.444030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.444773 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.445435 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.446372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.447101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.447754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.509248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-4b483dcf-3a6c-40a7-bce1-17f2d20d2163 req-8f28b5cf-8fdd-4ee1-be01-5eb8d3ba4647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df7ed3f-dd6d-4312-a548-591443add019", "tag": "88d08060-53df-4d74-b5dd-97e3666abaeb"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:50.558856 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4b483dcf-3a6c-40a7-bce1-17f2d20d2163 req-8f28b5cf-8fdd-4ee1-be01-5eb8d3ba4647 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.559388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4b483dcf-3a6c-40a7-bce1-17f2d20d2163 req-8f28b5cf-8fdd-4ee1-be01-5eb8d3ba4647 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.559816 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4b483dcf-3a6c-40a7-bce1-17f2d20d2163 req-8f28b5cf-8fdd-4ee1-be01-5eb8d3ba4647 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.650333 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-4b483dcf-3a6c-40a7-bce1-17f2d20d2163 req-8f28b5cf-8fdd-4ee1-be01-5eb8d3ba4647 service nova] Creating event network-changed:88d08060-53df-4d74-b5dd-97e3666abaeb for instance 2df7ed3f-dd6d-4312-a548-591443add019 on hv-cinder-85799 Sep 16 03:48:50.651475 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4b483dcf-3a6c-40a7-bce1-17f2d20d2163 req-8f28b5cf-8fdd-4ee1-be01-5eb8d3ba4647 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 03:48:50.652640 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4b483dcf-3a6c-40a7-bce1-17f2d20d2163 req-8f28b5cf-8fdd-4ee1-be01-5eb8d3ba4647 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 03:48:50.653948 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.655681 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.656814 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.658850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.660761 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.661964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:50.665506 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.677167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e4876436-f49c-4154-b20a-cbe62c1702dc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1299 microversion: 2.1 time: 0.259890 Sep 16 03:48:50.688161 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 31/56] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:50 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:50.703593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:50.704919 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:50.705960 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.compute.rpcapi [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 03:48:50.707381 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] Releasing lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 03:48:50.715716 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.716643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.731035 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.732561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.734950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.735586 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.763241 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2e069dd2-5fba-4064-9b3f-adc9886f4e4e None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.683574 Sep 16 03:48:50.765424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 26/57] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:50.832651 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:50.838321 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:50.852057 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.855173 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.883677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.885514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:50.891932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:50.893208 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:50.898201 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:50.913456 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:50.920671 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:50.931483 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-48b17b5f-a427-47e6-b7ae-11e20763c92f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1332 microversion: 2.20 time: 0.241184 Sep 16 03:48:50.942254 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 32/58] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:50 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1332 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:51.096221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:51.096834 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:51.113853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:51.115234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:51.118858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:51.120046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:51.121800 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:51.125175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:51.619540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:51.631642 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2b0023e9-5680-4b8f-ad54-29baee760806 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.806092 Sep 16 03:48:51.648470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 27/59] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:50 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:51.655995 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:51.661349 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:51.666361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:51.667154 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:51.667832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:51.669008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:51.669628 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:51.670874 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:51.899283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:51.913645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-99390a1a-fb3f-4c5d-b2ba-42d94eb767db tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.828636 Sep 16 03:48:51.915145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 33/60] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:51 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:51.924221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:51.925262 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:51.932601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:51.933383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:51.935125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:51.948799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:51.952062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:51.952738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:52.147751 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=34 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:52.327795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:52.330531 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:52.353587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a238ac0f-7ee2-4086-8c3b-baeb2bfcd2c1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.702705 Sep 16 03:48:52.354196 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 28/61] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:51 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:52.354489 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6c4440cc-32f7-4a34-aac3-ca03838ba1ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1299 microversion: 2.1 time: 0.435387 Sep 16 03:48:52.358347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 34/62] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:51 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1299 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:52.379724 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:52.414628 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:52.441550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:52.443063 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:52.444995 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:52.445780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:52.446246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:52.448035 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:52.509895 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:52.652488 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:52.669364 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:52.670094 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:52.672479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:52.674058 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c6a50a74-64da-47d0-808e-edebfb37e217 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1338 microversion: 2.20 time: 0.314693 Sep 16 03:48:52.674982 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 29/63] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:52 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1338 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:52.675431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:52.689010 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:52.689512 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:52.689952 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:52.699656 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:52.700159 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:52.711072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:52.941427 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:52.942383 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:52.959734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:52.960483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:52.960936 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:52.961660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:52.962114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:52.962539 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:53.449963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:53.468305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c51e0400-677f-47b3-8ad2-c85f8b1ced49 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.529940 Sep 16 03:48:53.476362 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 30/64] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:52 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:53.479830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:53.482960 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:53.492504 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:53.493946 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:53.494986 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:53.497227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:53.510658 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:53.511796 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:53.625013 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:53.633552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-305c1a9e-720d-4ddd-b323-fd6326476775 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.976003 Sep 16 03:48:53.647266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 35/65] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:52 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:53.653886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:53.653886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:53.665314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:53.666056 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:53.666825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:53.667723 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:53.668305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:53.668855 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:53.773595 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=32 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:53.795162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:53.804223 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5764015c-d4e9-4261-b1d4-4b84c6ad6497 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1299 microversion: 2.1 time: 0.155582 Sep 16 03:48:53.815668 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 36/66] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:53 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:53.820560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-2a92b77e-e902-40d8-8f94-1fee09b958e5 req-1fe4f04a-ffb6-4572-9c83-ec3879ab0e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea00b9d-1f8f-4428-98f7-9d66fd079c6d", "tag": "8e2fa910-3468-43c4-b9c0-ed6a542e2f12"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:53.840987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2a92b77e-e902-40d8-8f94-1fee09b958e5 req-1fe4f04a-ffb6-4572-9c83-ec3879ab0e71 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:53.842251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2a92b77e-e902-40d8-8f94-1fee09b958e5 req-1fe4f04a-ffb6-4572-9c83-ec3879ab0e71 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:53.843322 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2a92b77e-e902-40d8-8f94-1fee09b958e5 req-1fe4f04a-ffb6-4572-9c83-ec3879ab0e71 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:53.857901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-2a92b77e-e902-40d8-8f94-1fee09b958e5 req-1fe4f04a-ffb6-4572-9c83-ec3879ab0e71 service nova] Creating event network-changed:8e2fa910-3468-43c4-b9c0-ed6a542e2f12 for instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d on hv-cinder-85799 Sep 16 03:48:53.866196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-2a92b77e-e902-40d8-8f94-1fee09b958e5 req-1fe4f04a-ffb6-4572-9c83-ec3879ab0e71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048593 Sep 16 03:48:53.867064 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 37/67] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:53.874802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:53.875944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:53.889583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:53.889583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:53.889583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:53.889583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:53.889890 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:53.889890 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:54.040863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:54.081877 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:54.090880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:54.098952 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7e23b3e1-b020-4774-862d-dffa52d5df33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1338 microversion: 2.20 time: 0.227652 Sep 16 03:48:54.101146 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 38/68] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:53 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1338 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:54.272032 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:54.289388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-80486b21-a3da-4046-8ef4-4eed25fa35e6 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.815374 Sep 16 03:48:54.294074 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 31/69] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:53 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:54.497951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:54.498829 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:54.512408 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:54.515364 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:54.515812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:54.520235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:54.520717 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:54.521164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:54.659947 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:54.660695 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:54.672274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:54.675327 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:54.675885 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:54.677081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:54.679596 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:54.680427 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:55.183579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:55.191848 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-daa8b16c-e06d-4512-9668-c4639825c90d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.537355 Sep 16 03:48:55.195962 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 32/70] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:54 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:55.209674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:55.210496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:55.224996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:55.225473 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:55.225913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:55.228873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:55.229354 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:55.229787 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:55.327722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:55.359293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9095849e-a1ce-449f-8d8a-9fe8f15bacb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.863641 Sep 16 03:48:55.367062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 39/71] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:54 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:55.378817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:55.387930 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:55.398418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:55.398934 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:55.399413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:55.400197 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:55.400650 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:55.401081 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:55.731607 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:55.748724 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bf7cfd31-6a8f-4522-9e9c-d2f4ec444dfa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.551280 Sep 16 03:48:55.756631 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 33/72] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:55 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:55.778725 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:55.782570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:55.807585 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:55.808355 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:55.808950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:55.809868 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:55.811396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:55.814326 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:56.316657 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:56.334199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:56.336124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:56.336768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-207f1863-b92b-46aa-877c-2eabf8bcafeb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.968511 Sep 16 03:48:56.354030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 40/73] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:55 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:56.354030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-3aa78739-e4c6-4bca-8f47-a9afe2c0b6f7 req-3c50d9ab-ddba-4b8f-bab3-f348d85ccf63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806", "tag": "638a834b-f18e-4522-9cce-b0662c140379"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:56.362516 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3aa78739-e4c6-4bca-8f47-a9afe2c0b6f7 req-3c50d9ab-ddba-4b8f-bab3-f348d85ccf63 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:56.363204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3aa78739-e4c6-4bca-8f47-a9afe2c0b6f7 req-3c50d9ab-ddba-4b8f-bab3-f348d85ccf63 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:56.363808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3aa78739-e4c6-4bca-8f47-a9afe2c0b6f7 req-3c50d9ab-ddba-4b8f-bab3-f348d85ccf63 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:56.387944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-3aa78739-e4c6-4bca-8f47-a9afe2c0b6f7 req-3c50d9ab-ddba-4b8f-bab3-f348d85ccf63 service nova] Creating event network-changed:638a834b-f18e-4522-9cce-b0662c140379 for instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 on hv-cinder-85799 Sep 16 03:48:56.400821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-3aa78739-e4c6-4bca-8f47-a9afe2c0b6f7 req-3c50d9ab-ddba-4b8f-bab3-f348d85ccf63 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051542 Sep 16 03:48:56.406072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 41/74] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:56.417659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:56.418772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:56.429507 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:56.430540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:56.431618 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:56.432575 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:56.433189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:56.433940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:56.734358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:56.747566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-92359d21-4e7d-4292-9a6d-89dcb9f580a3 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.981247 Sep 16 03:48:56.749733 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 34/75] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:55 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:56.771013 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:56.773655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:56.787786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:56.793221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:56.795723 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:56.796155 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:56.797552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:56.799219 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:56.895616 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:56.911018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c1689fc8-ace4-4845-b8a3-47b65d9af4c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.507997 Sep 16 03:48:56.911737 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 42/76] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:56 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:56.936819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:56.937889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:56.956639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:56.957511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:56.958395 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:56.959441 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:56.960173 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:56.960922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:57.271783 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:57.283277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ab3eb7a8-5466-49cf-b05c-e7e195301f44 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.532096 Sep 16 03:48:57.295536 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 35/77] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:56 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:57.377184 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:57.381490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:57.386189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:57.406841 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4cff391d-a330-4bb2-8806-fc5ae3947054 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.486179 Sep 16 03:48:57.407162 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:57.410572 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:57.411101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:57.412849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:57.414232 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:57.417398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:57.430977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 43/78] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:56 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:57.431194 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-7b3d79d7-0c42-49b8-92f1-4ec64efdb317 req-73163e06-c41b-42cb-918d-d2cbc26b0437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fee7fbd-189b-4a53-ba78-d66512c7b09d", "tag": "0ec6698f-782e-4670-8cd3-efb57d7433ad"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:57.457007 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7b3d79d7-0c42-49b8-92f1-4ec64efdb317 req-73163e06-c41b-42cb-918d-d2cbc26b0437 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:57.457500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7b3d79d7-0c42-49b8-92f1-4ec64efdb317 req-73163e06-c41b-42cb-918d-d2cbc26b0437 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:57.457931 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7b3d79d7-0c42-49b8-92f1-4ec64efdb317 req-73163e06-c41b-42cb-918d-d2cbc26b0437 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:57.483054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-7b3d79d7-0c42-49b8-92f1-4ec64efdb317 req-73163e06-c41b-42cb-918d-d2cbc26b0437 service nova] Creating event network-changed:0ec6698f-782e-4670-8cd3-efb57d7433ad for instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d on hv-cinder-85799 Sep 16 03:48:57.488229 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-7b3d79d7-0c42-49b8-92f1-4ec64efdb317 req-73163e06-c41b-42cb-918d-d2cbc26b0437 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066992 Sep 16 03:48:57.488835 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 44/79] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:57.613517 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:57.623590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:57.627158 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:57.628335 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8320fd03-5117-4ecc-9b72-219028b57b6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.257631 Sep 16 03:48:57.629168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 36/80] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:57 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:57.774835 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:57.776142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:57.784332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:57.784982 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:57.785669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:57.786677 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:57.787526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:57.788231 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:57.936083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:57.936866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:57.944246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:57.945153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:57.945729 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:57.946527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:57.947276 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:57.947777 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:58.093410 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:58.097629 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:58.101294 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-94fd2c69-2bd9-4a17-922f-88717bf482b6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.169561 Sep 16 03:48:58.102046 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 37/81] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:57 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:58.106929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-18e78b8e-b017-45f9-860e-412f453526e8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.336732 Sep 16 03:48:58.120412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 45/82] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:57 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:58.323537 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:58.324579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:58.332318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:58.332782 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:58.333413 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:58.334139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:58.334750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:58.335210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:58.445699 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:58.446372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:58.453381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:58.453606 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:58.454362 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:58.455221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:58.455721 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:58.456084 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:58.470623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:58.480424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cb3ba6dc-75b6-4dab-8730-b047361f2654 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.164670 Sep 16 03:48:58.496698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 38/83] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:58 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:58.653577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:58.654245 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:58.656455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:58.664667 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-25906add-fcc4-4a2f-8d0b-aed70c11301a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.223059 Sep 16 03:48:58.665177 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 46/84] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:58 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:58.665681 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:58.666180 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:58.666752 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:58.667619 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:58.668062 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:58.668622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:58.849741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:58.858977 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:58.860838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:58.862210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d8fe5aad-d66b-49c1-907f-925eccf2f290 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.212547 Sep 16 03:48:58.863299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 39/85] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:58 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:48:59.125264 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:59.125880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:59.133120 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.133613 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.134052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.134889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.135531 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.135951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.141270 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:59.141966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:59.148055 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.148572 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.149018 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.149720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.150179 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.150600 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.304749 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:59.314504 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-07979e74-12ef-4911-b3ba-ec393a09e712 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.185779 Sep 16 03:48:59.315601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 40/86] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:59 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:48:59.332392 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:59.347281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-91ace05f-8458-48ef-99cc-b419354a7e78 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.225895 Sep 16 03:48:59.349260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 47/87] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:59 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:59.505119 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:59.505740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:59.511737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.512409 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.512852 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.513552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.514007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.514528 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.655127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-563c7553-fbbc-4075-8b3c-a3ce3c8f26c1 req-a7e66d76-6802-43e7-86b6-def82e88b806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230b59e9-09d0-4448-a6a6-a395823fcd8b", "tag": "a04cc8c1-86e6-4381-8e36-de59ce5d9321"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:48:59.663607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=10 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:59.670205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-563c7553-fbbc-4075-8b3c-a3ce3c8f26c1 req-a7e66d76-6802-43e7-86b6-def82e88b806 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.670836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-563c7553-fbbc-4075-8b3c-a3ce3c8f26c1 req-a7e66d76-6802-43e7-86b6-def82e88b806 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.671431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-563c7553-fbbc-4075-8b3c-a3ce3c8f26c1 req-a7e66d76-6802-43e7-86b6-def82e88b806 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.684004 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:48:59.692238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:59.693871 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-022546d5-5cbd-4f72-adab-e01816665ccd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.192719 Sep 16 03:48:59.694445 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 41/88] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:59 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:48:59.698959 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:59.699380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-563c7553-fbbc-4075-8b3c-a3ce3c8f26c1 req-a7e66d76-6802-43e7-86b6-def82e88b806 service nova] Creating event network-changed:a04cc8c1-86e6-4381-8e36-de59ce5d9321 for instance 230b59e9-09d0-4448-a6a6-a395823fcd8b on hv-cinder-85799 Sep 16 03:48:59.699632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:59.709684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.710295 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.711052 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.711832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.721146 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-563c7553-fbbc-4075-8b3c-a3ce3c8f26c1 req-a7e66d76-6802-43e7-86b6-def82e88b806 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067259 Sep 16 03:48:59.721378 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.721378 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.721564 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 48/89] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:48:59.900843 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:48:59.902095 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:48:59.912137 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.913268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.913925 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:48:59.915238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:48:59.915757 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:48:59.916468 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:00.082304 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:00.093080 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:00.094552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:00.095704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-64c89a0d-bf12-4acd-8b11-e144f2451d2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.204941 Sep 16 03:49:00.096257 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 49/90] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:48:59 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:00.098760 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:00.107723 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7bbba4d5-5899-4b28-bb90-923a34d72c87 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.412230 Sep 16 03:49:00.122626 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 42/91] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:48:59 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:00.338790 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:00.339524 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:00.346614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:00.347205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:00.351711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:00.351711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:00.351711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:00.351711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:00.373872 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:00.375349 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:00.381369 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:00.381848 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:00.386233 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:00.386233 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:00.386233 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:00.386233 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:00.516325 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:00.525122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a22d119a-20cd-4c83-b9f2-53539112c0a8 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.190351 Sep 16 03:49:00.538332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 50/92] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:00 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:00.571065 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:00.583383 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cafa9f0c-9c9e-46b9-b7dc-dce50c303601 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.212902 Sep 16 03:49:00.584328 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 43/93] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:00 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:00.717924 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:00.719963 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:00.725012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:00.725501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:00.725937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:00.726638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:00.727230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:00.727684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:00.880853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:00.890108 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ae5721a1-8746-4b7d-bd22-f69cf9260f69 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.176315 Sep 16 03:49:00.891887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 51/94] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:00 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:01.135293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:01.136091 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:01.137108 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:01.138070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:01.152550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:01.153541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:01.154242 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:01.154844 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:01.155396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:01.156135 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:01.160014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:01.160145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:01.160145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:01.160320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:01.160320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:01.160320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:01.334598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:01.343213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5066f8a0-3f1a-4910-bd0b-6873ddf5a1c8 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.217143 Sep 16 03:49:01.343789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 52/95] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:01 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:01.450610 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:01.551671 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:01.552342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:01.558710 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:01.559552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:01.560004 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:01.561496 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:01.561948 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:01.562420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:01.734585 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:01.750803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:01.752878 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:01.756859 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f8db2ab-9d9a-4928-a28d-9219316aff37 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.634235 Sep 16 03:49:01.760307 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 44/96] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:01 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:01.774010 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:01.780013 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:01.789225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:01.791316 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:01.792046 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:01.792918 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:01.793623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:01.794473 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:02.196866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:02.208203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:02.211211 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8ad2d719-cf50-43be-80d1-96d475d33648 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.449661 Sep 16 03:49:02.214437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 45/97] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:01 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:02.237112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:02.237767 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:02.242336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:02.253097 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2db989dd-9796-4db3-a3d6-e180d0594a7e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.707532 Sep 16 03:49:02.253666 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 53/98] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:01 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:02.281635 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:02.282476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:02.284558 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:02.285559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:02.286209 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:02.286884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:02.367101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:02.367946 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:02.374935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:02.375627 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:02.376204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:02.377038 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:02.377641 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:02.378052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:02.584790 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:02.598397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d8c81256-3c15-48a4-a253-b92a570d858f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.382743 Sep 16 03:49:02.601608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 46/99] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:02 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:02.743886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:02.757656 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-83a3b3c1-63b2-4118-bffc-4eeb17b713b3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.394100 Sep 16 03:49:02.758616 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 54/100] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:02 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:02.785045 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:02.785934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:02.792417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:02.793127 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:02.798138 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:02.798138 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:02.798138 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:02.798138 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:02.940209 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:02.949358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:02.957282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:02.957282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ee696cc2-2011-457b-8e63-597e515c2e3d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.171754 Sep 16 03:49:02.957282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 47/101] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:02 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:03.240596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:03.241204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:03.249052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:03.250322 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:03.250780 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:03.251519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:03.252125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:03.252782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:03.276622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:03.277248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:03.283430 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:03.284132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:03.284750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:03.285615 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:03.286225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:03.286815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:03.439069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:03.453679 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a9d2d6fd-9fc5-466c-9148-5cd3bdc01090 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.216593 Sep 16 03:49:03.456069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 55/102] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:03 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:03.460741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:03.471756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e271cf86-ba12-4b13-9428-fcaa5ffb737f tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.198867 Sep 16 03:49:03.472843 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 48/103] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:03 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:03.627956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:03.628571 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:03.634889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:03.635414 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:03.635853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:03.636551 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:03.637005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:03.637574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:03.784859 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:03.786186 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:03.793758 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:03.795108 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:03.796805 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:03.797017 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:03.797650 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:03.798468 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:03.942282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:03.951874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-05c802d2-70c8-4b63-8887-4b53f6cb3fc4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.328136 Sep 16 03:49:03.952460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 56/104] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:03 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:03.986484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:03.987013 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:04.004062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.004822 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.005748 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:04.006790 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.007498 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.008785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:04.098971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:04.108559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c3b5df15-291d-457d-b567-2caf68c32ed1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.330339 Sep 16 03:49:04.118931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 49/105] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:03 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:04.405383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:04.409299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-1edd3599-6963-4303-8446-3130889efc45 req-ff4e529a-1608-4d2f-b1cc-5674a5ed2ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea00b9d-1f8f-4428-98f7-9d66fd079c6d", "name": "network-vif-plugged", "status": "completed", "tag": "8e2fa910-3468-43c4-b9c0-ed6a542e2f12"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:04.415733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:04.417419 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:04.418680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8aa20911-221a-4b3b-a67f-e29dd9006f4e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.439409 Sep 16 03:49:04.418843 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-1edd3599-6963-4303-8446-3130889efc45 req-ff4e529a-1608-4d2f-b1cc-5674a5ed2ba6 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.419653 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-1edd3599-6963-4303-8446-3130889efc45 req-ff4e529a-1608-4d2f-b1cc-5674a5ed2ba6 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.420349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 57/106] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:03 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:04.421392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-1edd3599-6963-4303-8446-3130889efc45 req-ff4e529a-1608-4d2f-b1cc-5674a5ed2ba6 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:04.439706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-1edd3599-6963-4303-8446-3130889efc45 req-ff4e529a-1608-4d2f-b1cc-5674a5ed2ba6 service nova] Creating event network-vif-plugged:8e2fa910-3468-43c4-b9c0-ed6a542e2f12 for instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d on hv-cinder-85799 Sep 16 03:49:04.444865 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-1edd3599-6963-4303-8446-3130889efc45 req-ff4e529a-1608-4d2f-b1cc-5674a5ed2ba6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100760 Sep 16 03:49:04.445461 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 50/107] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:49:04.482253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:04.483278 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:04.496876 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:04.497455 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:04.501689 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.502263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.502755 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:04.503512 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.503961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.504381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:04.511584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.512106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.512542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:04.513234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.514034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.514683 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:04.678191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:04.694950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-165971b6-3494-49bd-9628-4669a82cace3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.213984 Sep 16 03:49:04.713406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:04.713795 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 58/108] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:04 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:04.722391 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7dde6cba-ad65-4288-b60a-559446d18769 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.229976 Sep 16 03:49:04.723237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 51/109] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:04 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:04.975572 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:04.976219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:04.982470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.982470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.983323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:04.984022 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:04.984639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:04.985220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.145552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:05.148111 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:05.156891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:05.157728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:05.158823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.160635 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:05.161284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:05.161939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.197570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:05.215135 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-937e3b90-2090-4fbc-a8e7-007340dd082d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.243658 Sep 16 03:49:05.215733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 59/110] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:04 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:05.430543 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:05.444862 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:05.446141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:05.450086 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ae89180d-85b1-49b6-b00c-e0419c8f61c1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.311666 Sep 16 03:49:05.468486 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 52/111] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:05 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:05.472914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:05.473701 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:05.474445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.475216 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:05.475782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:05.476576 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.675599 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:05.688361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:05.691502 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:05.693052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cd002aab-3e70-43a8-ba53-6e57f3d6f1ae tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.252230 Sep 16 03:49:05.693673 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 60/112] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:05 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:05.721800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:05.722500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:05.728744 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:05.729228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:05.729655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.730341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:05.730968 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:05.731389 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.747594 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:05.748460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:05.755428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:05.756123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:05.756701 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.761885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:05.762529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:05.763229 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:05.881282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:05.889751 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-32ced416-d5cb-413a-8975-f452ed907b86 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.171694 Sep 16 03:49:05.890596 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 53/113] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:05 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:05.932273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:05.944470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e49ec96d-628a-45d2-aa27-65e548439a64 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.201240 Sep 16 03:49:05.945393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 61/114] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:05 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:06.238597 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:06.239562 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:06.246228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.246816 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.247286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.248267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.253786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.254372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.407203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:06.415425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b7de1dab-d05c-4124-a1c2-6a4335e92a21 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.181280 Sep 16 03:49:06.416634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 54/115] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:06 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:06.489908 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-568a3959-987b-4cb7-9cf4-75b05a7859d6 req-a913e86a-cb6a-450b-a09f-5392fd8f4baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df7ed3f-dd6d-4312-a548-591443add019", "name": "network-vif-plugged", "status": "completed", "tag": "88d08060-53df-4d74-b5dd-97e3666abaeb"}, {"server_uuid": "14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806", "name": "network-vif-plugged", "status": "completed", "tag": "638a834b-f18e-4522-9cce-b0662c140379"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:06.490390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:06.490390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:06.496536 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.497142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.497767 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.499367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.502856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-568a3959-987b-4cb7-9cf4-75b05a7859d6 req-a913e86a-cb6a-450b-a09f-5392fd8f4baa service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.503769 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.504383 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.508775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-568a3959-987b-4cb7-9cf4-75b05a7859d6 req-a913e86a-cb6a-450b-a09f-5392fd8f4baa service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.509285 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-568a3959-987b-4cb7-9cf4-75b05a7859d6 req-a913e86a-cb6a-450b-a09f-5392fd8f4baa service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.535705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-568a3959-987b-4cb7-9cf4-75b05a7859d6 req-a913e86a-cb6a-450b-a09f-5392fd8f4baa service nova] Creating event network-vif-plugged:88d08060-53df-4d74-b5dd-97e3666abaeb for instance 2df7ed3f-dd6d-4312-a548-591443add019 on hv-cinder-85799 Sep 16 03:49:06.539624 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-568a3959-987b-4cb7-9cf4-75b05a7859d6 req-a913e86a-cb6a-450b-a09f-5392fd8f4baa service nova] Creating event network-vif-plugged:638a834b-f18e-4522-9cce-b0662c140379 for instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 on hv-cinder-85799 Sep 16 03:49:06.547415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-568a3959-987b-4cb7-9cf4-75b05a7859d6 req-a913e86a-cb6a-450b-a09f-5392fd8f4baa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080174 Sep 16 03:49:06.548324 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 62/116] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:06.709782 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:06.717886 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fbadf03e-adf7-4884-b1f6-36231e0d3900 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.242759 Sep 16 03:49:06.718469 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 55/117] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:06 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:06.720772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:06.721533 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:06.732117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.732757 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.733195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.733938 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.734409 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.734860 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.893002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:06.906812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:06.908270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:06.910562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b5facfe2-a1d2-4da7-a255-619b70737afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.193382 Sep 16 03:49:06.910562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 63/118] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:06 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:06.915585 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:06.916391 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:06.925129 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.925616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.926047 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.927716 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.928176 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.928605 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.971827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:06.972431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:06.983995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.984682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.985113 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:06.985867 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:06.986242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:06.986659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:07.095147 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:07.104884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f4ab2ad0-7e7b-46d9-8195-9ff8f3f72fbd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.195103 Sep 16 03:49:07.106323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 56/119] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:06 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:07.237679 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:07.245779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e0636aa4-3dec-43dd-882f-eaf9aebd7a10 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.278300 Sep 16 03:49:07.249054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 64/120] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:06 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:07.446495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:07.447227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:07.454188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:07.454942 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:07.460266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:07.460266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:07.460266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:07.460266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:07.602614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:07.612963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7328b1b3-c20e-4151-92c0-cde202e5ffdb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.170171 Sep 16 03:49:07.613554 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 57/121] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:07 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:07.741449 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:07.741994 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:07.748956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:07.749439 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:07.749865 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:07.750552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:07.751018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:07.751436 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:07.935213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:07.936020 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:07.942044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:07.942669 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:07.943240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:07.944198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:07.944893 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:07.945418 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:07.962002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:07.971218 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8be88ba5-2bad-4261-a614-b80a5326fe8d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.233380 Sep 16 03:49:07.978956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 65/122] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:07 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:08.090549 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:08.109845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:08.121939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:08.124150 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-27212cf8-dcfd-4d7a-a403-e69303a2ec86 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.192924 Sep 16 03:49:08.125227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 58/123] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:07 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:49:08.147999 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:08.148611 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:08.154936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:08.155435 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:08.156097 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:08.156797 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:08.157414 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:08.157859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:08.163825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:08.275073 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:08.275786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:08.282583 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:08.283190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:08.283730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:08.284487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:08.285035 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:08.285523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:08.297467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:08.305495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-20361500-454d-456f-a9da-7324767f77fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.164442 Sep 16 03:49:08.306061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 66/124] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:08 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:08.490240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:08.498550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c123ad6d-1ffc-42a1-98e3-848bfcaeb2f1 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.227035 Sep 16 03:49:08.499082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 59/125] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:08 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:08.565434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-58fe5467-11cf-492c-84ed-64eefc53ce77 req-a64340f8-f6a3-4bcf-bebb-08da28f4d562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234c7287-59d4-425c-ba2b-56031d311ee6", "name": "network-vif-plugged", "status": "completed", "tag": "19b4f355-bc74-46bb-9c3e-debddf171414"}, {"server_uuid": "6fee7fbd-189b-4a53-ba78-d66512c7b09d", "name": "network-vif-plugged", "status": "completed", "tag": "0ec6698f-782e-4670-8cd3-efb57d7433ad"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:08.583959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-58fe5467-11cf-492c-84ed-64eefc53ce77 req-a64340f8-f6a3-4bcf-bebb-08da28f4d562 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:08.584438 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-58fe5467-11cf-492c-84ed-64eefc53ce77 req-a64340f8-f6a3-4bcf-bebb-08da28f4d562 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:08.584858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-58fe5467-11cf-492c-84ed-64eefc53ce77 req-a64340f8-f6a3-4bcf-bebb-08da28f4d562 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:08.599222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-58fe5467-11cf-492c-84ed-64eefc53ce77 req-a64340f8-f6a3-4bcf-bebb-08da28f4d562 service nova] Creating event network-vif-plugged:19b4f355-bc74-46bb-9c3e-debddf171414 for instance 234c7287-59d4-425c-ba2b-56031d311ee6 on hv-cinder-85799 Sep 16 03:49:08.599731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-58fe5467-11cf-492c-84ed-64eefc53ce77 req-a64340f8-f6a3-4bcf-bebb-08da28f4d562 service nova] Creating event network-vif-plugged:0ec6698f-782e-4670-8cd3-efb57d7433ad for instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d on hv-cinder-85799 Sep 16 03:49:08.605999 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-58fe5467-11cf-492c-84ed-64eefc53ce77 req-a64340f8-f6a3-4bcf-bebb-08da28f4d562 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044306 Sep 16 03:49:08.606617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 67/126] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:08.636857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:08.637470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:08.644012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:08.644498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:08.644933 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:08.645629 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:08.646078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:08.646686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:08.842234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:08.849959 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aee8509f-49e4-4a42-b897-bef80249711d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1322 microversion: 2.1 time: 0.216974 Sep 16 03:49:08.850533 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 60/127] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:08 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:08.994968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:08.995680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:09.015134 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.015627 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.016063 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.016956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.017418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.018009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.171773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:09.172418 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:09.174669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:09.195025 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.197806 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.198415 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.199558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-74ddc25f-cd75-4e6c-861c-720ad88e0cba tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.208179 Sep 16 03:49:09.201885 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.203556 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.204160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.206246 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 68/128] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:08 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:09.331760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:09.332377 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:09.343154 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:09.347469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.347969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.348409 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.349122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.349579 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.350007 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.533168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:09.535684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:09.537897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:09.539060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8497c47c-6661-4446-84f5-7ceb17913a65 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.386493 Sep 16 03:49:09.540150 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 61/129] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:09 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:09.556031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:09.558432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:09.559935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:09.576897 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7732807e-37aa-4ddf-b304-4ebe7c26129a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1363 microversion: 2.1 time: 0.243413 Sep 16 03:49:09.576897 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 69/130] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:09 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:09.577076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.577076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.577076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.577076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.577407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.577407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.781778 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:09.792457 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e646783a-9de1-4d3b-a1bc-b8398f4c0f81 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.249032 Sep 16 03:49:09.792457 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 62/131] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:09 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:09.873827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:09.874555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:09.880693 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.881265 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.881771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:09.882556 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:09.883211 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:09.883919 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.032525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:10.042419 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2dde5a9b-c1f1-4565-aaa0-c9017ff5fe2d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1515 microversion: 2.1 time: 0.173393 Sep 16 03:49:10.043324 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 70/132] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:09 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:10.071190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:10.074382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:10.081457 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.081935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.082637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.083361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.083955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.084521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.168279 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:10.183443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lazy-loading 'flavor' on Instance uuid 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:49:10.225751 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:10.226438 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:10.234352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.234839 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.235453 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.236323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.236932 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.237357 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.376005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:10.384300 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b762ba6a-ca8f-4184-80f0-d22a16290c5a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.162412 Sep 16 03:49:10.385055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 71/133] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:10 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:10.565520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:10.566144 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:10.572383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.572799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.573239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.573925 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.574675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.575280 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.621550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5e0169c5-261f-4298-a5b0-974cb3b3e847 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806/action" status: 200 len: 32 microversion: 2.1 time: 0.556251 Sep 16 03:49:10.640169 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 63/134] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:49:10 2022] POST /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806/action => generated 32 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 03:49:10.647177 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:10.647880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:10.655212 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.655709 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.656304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.657163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.657781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.658206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.858181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:10.868330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5071e6d4-2ab3-4e89-9f22-b8e3eb3ecbc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1548 microversion: 2.1 time: 0.226555 Sep 16 03:49:10.869181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 64/135] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:10 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:10.875148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-8546a955-645b-4259-8664-a6fc7a383d0f req-13590f63-954d-476d-8d35-db47e6d3fc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230b59e9-09d0-4448-a6a6-a395823fcd8b", "name": "network-vif-plugged", "status": "completed", "tag": "a04cc8c1-86e6-4381-8e36-de59ce5d9321"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:10.890646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-8546a955-645b-4259-8664-a6fc7a383d0f req-13590f63-954d-476d-8d35-db47e6d3fc6a service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.891232 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-8546a955-645b-4259-8664-a6fc7a383d0f req-13590f63-954d-476d-8d35-db47e6d3fc6a service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.891831 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-8546a955-645b-4259-8664-a6fc7a383d0f req-13590f63-954d-476d-8d35-db47e6d3fc6a service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.902754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:10.903556 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-8546a955-645b-4259-8664-a6fc7a383d0f req-13590f63-954d-476d-8d35-db47e6d3fc6a service nova] Creating event network-vif-plugged:a04cc8c1-86e6-4381-8e36-de59ce5d9321 for instance 230b59e9-09d0-4448-a6a6-a395823fcd8b on hv-cinder-85799 Sep 16 03:49:10.909403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-8546a955-645b-4259-8664-a6fc7a383d0f req-13590f63-954d-476d-8d35-db47e6d3fc6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038639 Sep 16 03:49:10.910187 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 65/136] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:10.912378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:10.914252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:10.915472 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3d871a84-6d58-41fa-8dad-ba81d62805bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.354094 Sep 16 03:49:10.916177 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 72/137] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:10 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:49:10.917870 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:10.918563 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:10.921763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:10.935856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:10.936003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.936003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.936003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.936003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.936358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.936358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.936519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.936519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.936519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:10.936519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:10.936825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:10.936825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:11.072278 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:11.093286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a53568da-79e3-4f14-847d-2025e29ab57e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.166910 Sep 16 03:49:11.093286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 66/138] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:10 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:11.093286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:11.093286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:11.093286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:11.093775 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:11.093849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:11.094501 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:11.094963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:11.095380 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:11.175467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f2f5f2e1-f137-4dd9-9bf4-c800b7811ff5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091775 Sep 16 03:49:11.177916 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 67/139] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 16 03:49:11 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:11.184059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:11.198347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7d890be7-b670-4e46-9e28-c056ecfd4494 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.280773 Sep 16 03:49:11.208372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 73/140] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:10 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:11.409991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:11.411012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:11.418678 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:11.419974 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:11.420651 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:11.421586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:11.422370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:11.423250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:11.957176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:11.958395 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:11.966512 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:11.967363 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:11.968069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:11.969030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:11.969466 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:11.973712 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:12.015181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:12.026316 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-379b09a1-5314-47ae-94ed-5541b7cee714 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1366 microversion: 2.1 time: 0.621020 Sep 16 03:49:12.027451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 68/141] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:11 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1366 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:12.105652 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:12.106800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:12.110300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:12.113846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:12.114505 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:12.115116 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:12.116077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:12.116671 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:12.117385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:12.150771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:12.160767 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:12.162740 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:12.173221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-95b562b8-7540-45ae-9b8a-410643a78cf7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.225702 Sep 16 03:49:12.174511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 74/142] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:11 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:12.234436 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:12.235755 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:12.242176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:12.243007 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:12.244053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:12.245067 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:12.252830 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:12.252830 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:12.438583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:12.447923 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e539f6d6-dba2-43e9-8840-199c0db8a455 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1314 microversion: 2.1 time: 0.217111 Sep 16 03:49:12.462939 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 75/143] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:12 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:12.623581 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:12.636106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b99441e4-f5ec-4969-b404-3dd585118562 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.534210 Sep 16 03:49:12.637002 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 69/144] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:12 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:13.053778 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:13.054455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:13.076590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.077110 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.080296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.083781 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.086099 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.086556 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.200458 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:13.202018 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:13.210664 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.211731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.212544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.213868 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.214631 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.215353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.323976 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:13.337759 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fc184770-db56-46d8-8804-5196987c0529 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1557 microversion: 2.1 time: 0.287815 Sep 16 03:49:13.351289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 76/145] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:13 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1557 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:13.367735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:13.369051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:13.375855 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.376582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.377142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.378064 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.378694 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.379309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.522277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ae976c28-cd07-4b56-991d-8881417a511b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159156 Sep 16 03:49:13.523319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 77/146] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 16 03:49:13 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:49:13.530205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:13.531573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:13.540451 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.541113 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.541787 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.542985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.543598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.544307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.695904 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:13.712598 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:13.727287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:13.728875 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-972bc181-33ea-4087-aec2-067660470afe tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.532877 Sep 16 03:49:13.736217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 70/147] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:13 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:13.760994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:13.761617 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:13.778154 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.778651 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.779406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.780228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:13.780686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:13.781112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:13.876215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:13.886788 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-70e5c11b-4afc-45f0-addb-e618176b2812 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1499 microversion: 2.1 time: 0.362086 Sep 16 03:49:13.890429 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 78/148] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:13 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1499 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:14.101779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-eea4b748-b24d-4a45-870d-f8bee11527e7 req-dfe86519-b9ab-420a-b316-6e2884325a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df7ed3f-dd6d-4312-a548-591443add019", "tag": "88d08060-53df-4d74-b5dd-97e3666abaeb"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:14.126848 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eea4b748-b24d-4a45-870d-f8bee11527e7 req-dfe86519-b9ab-420a-b316-6e2884325a99 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:14.127368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eea4b748-b24d-4a45-870d-f8bee11527e7 req-dfe86519-b9ab-420a-b316-6e2884325a99 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:14.127806 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eea4b748-b24d-4a45-870d-f8bee11527e7 req-dfe86519-b9ab-420a-b316-6e2884325a99 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:14.165807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-eea4b748-b24d-4a45-870d-f8bee11527e7 req-dfe86519-b9ab-420a-b316-6e2884325a99 service nova] Creating event network-changed:88d08060-53df-4d74-b5dd-97e3666abaeb for instance 2df7ed3f-dd6d-4312-a548-591443add019 on hv-cinder-85799 Sep 16 03:49:14.180786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-eea4b748-b24d-4a45-870d-f8bee11527e7 req-dfe86519-b9ab-420a-b316-6e2884325a99 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082181 Sep 16 03:49:14.181950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 79/149] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:14.248169 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:14.257456 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5624147d-a874-4be2-8254-03021e4fb249 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.520075 Sep 16 03:49:14.257948 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 71/150] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:13 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:14.768270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:14.769049 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:14.776537 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:14.777460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:14.778058 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:14.785500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:14.785500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:14.785500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:15.077814 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:15.096514 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:15.109583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:15.109583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-002b9dd0-534d-4789-b5d5-81eea6899a84 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1406 microversion: 2.20 time: 0.343155 Sep 16 03:49:15.109583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 80/151] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:14 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:49:15.282076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:15.282760 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:15.289222 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:15.289794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:15.290348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:15.291202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:15.291938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:15.292437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:15.535984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:15.560901 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c42b2a95-b96d-4a2c-b5a1-cf9447c78934 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.282431 Sep 16 03:49:15.565748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 72/152] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:15 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:15.599009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-eea5ba90-1031-4fca-909b-e5de818220d0 req-3d654488-2778-40ca-b0d8-4230bf6a2750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fee7fbd-189b-4a53-ba78-d66512c7b09d", "tag": "0ec6698f-782e-4670-8cd3-efb57d7433ad"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:15.608808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eea5ba90-1031-4fca-909b-e5de818220d0 req-3d654488-2778-40ca-b0d8-4230bf6a2750 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:15.609283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eea5ba90-1031-4fca-909b-e5de818220d0 req-3d654488-2778-40ca-b0d8-4230bf6a2750 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:15.609756 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eea5ba90-1031-4fca-909b-e5de818220d0 req-3d654488-2778-40ca-b0d8-4230bf6a2750 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:15.621304 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-eea5ba90-1031-4fca-909b-e5de818220d0 req-3d654488-2778-40ca-b0d8-4230bf6a2750 service nova] Creating event network-changed:0ec6698f-782e-4670-8cd3-efb57d7433ad for instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d on hv-cinder-85799 Sep 16 03:49:15.627140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-eea5ba90-1031-4fca-909b-e5de818220d0 req-3d654488-2778-40ca-b0d8-4230bf6a2750 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031777 Sep 16 03:49:15.627728 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 81/153] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:16.133680 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:16.134798 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:16.151542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:16.152414 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:16.153307 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:16.155662 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:16.173048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:16.174135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:16.433752 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:16.441093 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d7bb67-1cf9-442a-b145-342547b81589"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:16.443539 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:16.443687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:16.444978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:16.446324 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-70af9458-19cc-4139-b67c-c2ba1baf679e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1597 microversion: 2.20 time: 0.318172 Sep 16 03:49:16.448223 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 73/154] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:49:16 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1597 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:49:16.453579 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:16.454048 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:16.457016 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:16.459159 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:16.460420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:16.461489 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:16.485049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:16.486110 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:16.493992 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:16.494437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:16.494864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:16.495586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:16.496036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:16.496565 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:16.631142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7cafbb2e-4bab-4dc3-ae79-1adaefc5c1c4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160413 Sep 16 03:49:16.635365 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 74/155] 10.222.0.49 () {60 vars in 1316 bytes} [Fri Sep 16 03:49:16 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:49:16.643097 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:16.643717 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:16.659762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:16.659762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:16.659762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:16.660350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:16.661413 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:16.662000 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:17.020841 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:17.045225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1c35d56d-d76e-48d2-9444-9782135dc390 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.408432 Sep 16 03:49:17.057144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 75/156] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:16 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:17.830789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-17c373dd-e640-4006-add0-ae67af06c790 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "POST /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.392709 Sep 16 03:49:17.830789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 82/157] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:49:16 2022] POST /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6/os-volume_attachments => generated 194 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:49:18.026956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-f69a69ff-d390-4502-9723-17f5fe0f175f req-6bbd9108-7984-4b24-a1a4-15c1a665509c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230b59e9-09d0-4448-a6a6-a395823fcd8b", "tag": "a04cc8c1-86e6-4381-8e36-de59ce5d9321"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:18.038877 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f69a69ff-d390-4502-9723-17f5fe0f175f req-6bbd9108-7984-4b24-a1a4-15c1a665509c service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:18.038877 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f69a69ff-d390-4502-9723-17f5fe0f175f req-6bbd9108-7984-4b24-a1a4-15c1a665509c service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:18.038877 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f69a69ff-d390-4502-9723-17f5fe0f175f req-6bbd9108-7984-4b24-a1a4-15c1a665509c service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:18.056636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-f69a69ff-d390-4502-9723-17f5fe0f175f req-6bbd9108-7984-4b24-a1a4-15c1a665509c service nova] Creating event network-changed:a04cc8c1-86e6-4381-8e36-de59ce5d9321 for instance 230b59e9-09d0-4448-a6a6-a395823fcd8b on hv-cinder-85799 Sep 16 03:49:18.062502 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-f69a69ff-d390-4502-9723-17f5fe0f175f req-6bbd9108-7984-4b24-a1a4-15c1a665509c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039256 Sep 16 03:49:18.063719 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 76/158] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:18.076017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:18.076805 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:18.094548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:18.096552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:18.097418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:18.098261 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:18.101536 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:18.102780 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:18.287659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:18.291349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:18.295862 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d9d924b2-e621-4c78-8b8a-86eab96f7ed8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.226238 Sep 16 03:49:18.296420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 83/159] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:18 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:19.322061 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:19.323853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:19.332808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:19.333369 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:19.333806 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:19.334513 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:19.334998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:19.335475 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:19.480527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:19.488679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f9465eb3-1cc9-4da8-9c50-d59de33481f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.172186 Sep 16 03:49:19.489510 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 77/160] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:19 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:20.513098 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:20.513821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:20.520954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:20.521435 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:20.521864 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:20.522545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:20.523014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:20.523437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:20.660707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:20.666203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7ebd11ce-6a84-42ef-a39e-2501a68b9505 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.156944 Sep 16 03:49:20.666741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 84/161] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:20 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:21.690743 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:21.691394 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:21.698467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:21.699148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:21.699591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:21.700270 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:21.700803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:21.701284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:21.843280 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:21.850864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f2986627-94cd-4e4b-9bdb-81d2bfce9beb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.164849 Sep 16 03:49:21.851462 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 78/162] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:21 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:22.874884 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:22.875831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:22.883016 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:22.883505 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:22.883941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:22.884637 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:22.885082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:22.885533 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:23.033096 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:23.041532 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-22ae8dfd-4a49-4f83-9a73-7f14578e02d3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.171651 Sep 16 03:49:23.042271 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 85/163] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:22 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:24.066354 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:24.066997 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:24.073275 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:24.073762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:24.074199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:24.074884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:24.075393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:24.076473 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:24.284519 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:24.286514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:24.291667 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dbf81d43-86ba-4573-8a30-d1f3a945873a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.229296 Sep 16 03:49:24.292238 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 79/164] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:24 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:25.317854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:25.319347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:25.330150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:25.330860 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:25.336881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:25.336881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:25.336881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:25.336881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:25.524042 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:25.533572 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7e985386-b914-45d6-a8dd-89b65e08d9f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.220416 Sep 16 03:49:25.540170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 86/165] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:25 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:26.558334 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:26.563541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:26.568023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:26.568835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:26.569484 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:26.570405 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:26.571420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:26.572967 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:26.770483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:26.781044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f82c2d33-111d-4756-9461-84e08f6e5241 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.227066 Sep 16 03:49:26.781935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 80/166] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:26 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:27.805278 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:27.806656 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:27.814644 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:27.815591 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:27.816243 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:27.817193 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:27.817822 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:27.818422 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:27.956794 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:27.982242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fc2ec35e-92ae-46cf-a2f9-d441bcdea782 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.180950 Sep 16 03:49:27.983245 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 87/167] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:27 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:29.006259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:29.007547 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:29.014561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:29.015465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:29.016085 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:29.016947 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:29.017552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:29.018129 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:29.184489 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:29.196108 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2310095e-f2bc-4b8a-aab3-e8c0764f9007 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.192194 Sep 16 03:49:29.196733 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 81/168] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:29 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:30.222030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:30.222873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:30.232263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:30.239708 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:30.239708 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:30.239708 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:30.239708 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:30.240436 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:30.668971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:30.679550 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2dd1d9f5-7b73-46f3-b59d-74faa1502f85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.461945 Sep 16 03:49:30.680498 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 88/169] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:30 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:31.704775 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:31.705420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:31.711817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:31.712299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:31.712729 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:31.713414 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:31.713856 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:31.714272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:31.947494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:31.959192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-28172bd9-6ec5-48c3-afb1-8d855cadfe18 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.259181 Sep 16 03:49:31.971069 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 82/170] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:31 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:32.994504 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:32.995888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:33.010352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:33.010887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:33.013582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:33.014345 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:33.014817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:33.015353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:33.176654 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:33.193958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fb4acbf5-0c66-440b-a740-3e59d5f33bf8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.204142 Sep 16 03:49:33.193958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 89/171] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:32 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:34.210101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:34.211286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:34.221673 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:34.223030 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:34.224321 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:34.227591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:34.234593 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:34.234593 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:34.488514 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:34.489064 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:34.506060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:34.506575 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:34.511336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:34.511336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:34.512439 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:34.514374 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:34.576990 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:49:34.585943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:34.595102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6294d2cb-af48-4519-b50f-cafea916e313 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.389030 Sep 16 03:49:34.616325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 83/172] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:34 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:35.058675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cbebb438-fc6e-44c6-aa6b-2b1f7e957797 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "DELETE /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 204 len: 0 microversion: 2.1 time: 0.573742 Sep 16 03:49:35.062296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 90/173] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:49:34 2022] DELETE /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:49:35.071264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:35.072005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:35.081457 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:35.081962 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:35.082407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:35.083155 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:35.083618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:35.084656 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:35.224005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:35.233404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fcdc4168-b350-4c82-8e8a-122ed2516e09 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1551 microversion: 2.1 time: 0.165848 Sep 16 03:49:35.234006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 84/174] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:35 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:35.639924 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:35.643093 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:35.655855 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:35.656354 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:35.657278 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:35.658298 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:35.658944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:35.660708 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:35.839255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:35.856313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f0cf9337-87c9-43dc-8749-c10cd51216d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.235824 Sep 16 03:49:35.858411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 91/175] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:35 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:36.261288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:36.261904 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:36.275980 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:36.276485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:36.279320 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:36.281256 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:36.281815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:36.283410 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:36.487592 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:36.498296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-46d87152-e891-46d5-befc-cc4e711ab834 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1551 microversion: 2.1 time: 0.245920 Sep 16 03:49:36.498898 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 85/176] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:36 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1551 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:36.779302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70a7fc40-4453-4695-b768-4b548a956f32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Action: 'create', calling method: .version_select at 0x7fba7c9cbca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-752799329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbXMVjYKzbNWKIHtJvseKYfBnepUAYxgqBaoHklsfAveaWo15qS9XYVCyOFUrpqI6etu+dcyxSo+6fZAo1kTbjEgnDxpdHsKm7Iv0NCFDB5qaQQkyx4Kt88xBg/ZqH3Og=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:36.800084 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-70a7fc40-4453-4695-b768-4b548a956f32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Getting quotas for project 37a1aef0396c463d8a10f0ee811e1f2a. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:49:36.804412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-70a7fc40-4453-4695-b768-4b548a956f32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Getting quotas for user ede7a69d69084b3583433547473532be and project 37a1aef0396c463d8a10f0ee811e1f2a. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:49:36.884437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:36.885127 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:36.893470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:36.893470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:36.893470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:36.893754 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:36.893985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:36.894389 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:36.923644 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-70a7fc40-4453-4695-b768-4b548a956f32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.334079 Sep 16 03:49:36.925200 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 92/177] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:49:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:37.048012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:37.056382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-48fa53a3-b08e-4365-8796-c15f7f98ab3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.175713 Sep 16 03:49:37.057034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 86/178] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:36 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:37.524409 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:37.525165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:37.532423 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:37.536573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:37.537036 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:37.537859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:37.538638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:37.538815 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:37.703402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:37.713237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bf207dab-0ff4-4db7-a7eb-aadc457152e7 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1551 microversion: 2.1 time: 0.191583 Sep 16 03:49:37.713237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 93/179] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:37 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1551 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:38.081566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:38.082187 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:38.088421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:38.088906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:38.089555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:38.090277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:38.091254 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:38.091937 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:38.606576 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:38.616390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-95702eb7-81ba-4572-a123-4e0029430d74 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.538872 Sep 16 03:49:38.627830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 87/180] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:38 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:38.740220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:38.741827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:38.751578 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:38.752441 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:38.753037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:38.754101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:38.754745 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:38.755385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:38.941654 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:38.950225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-090b2916-f2fd-4d7f-8f18-e888e7d3f445 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1551 microversion: 2.1 time: 0.217279 Sep 16 03:49:38.951492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 94/181] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:38 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1551 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:39.089409 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-73e105f2-301e-4f28-b1b5-9d738a71d252 req-ea4b1469-da8a-4911-b268-14570e8a88c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234c7287-59d4-425c-ba2b-56031d311ee6", "name": "network-vif-deleted", "tag": "19b4f355-bc74-46bb-9c3e-debddf171414"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:39.101829 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-73e105f2-301e-4f28-b1b5-9d738a71d252 req-ea4b1469-da8a-4911-b268-14570e8a88c5 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:39.102705 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-73e105f2-301e-4f28-b1b5-9d738a71d252 req-ea4b1469-da8a-4911-b268-14570e8a88c5 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:39.103393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-73e105f2-301e-4f28-b1b5-9d738a71d252 req-ea4b1469-da8a-4911-b268-14570e8a88c5 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:39.122639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-73e105f2-301e-4f28-b1b5-9d738a71d252 req-ea4b1469-da8a-4911-b268-14570e8a88c5 service nova] Creating event network-vif-deleted:19b4f355-bc74-46bb-9c3e-debddf171414 for instance 234c7287-59d4-425c-ba2b-56031d311ee6 on hv-cinder-85799 Sep 16 03:49:39.140757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-73e105f2-301e-4f28-b1b5-9d738a71d252 req-ea4b1469-da8a-4911-b268-14570e8a88c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055010 Sep 16 03:49:39.143664 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 88/182] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:49:39.640771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:39.641437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:39.652608 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:39.654143 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:39.655306 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:39.669785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:39.669785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:39.669785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:39.845087 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:39.853536 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7879e2d2-882d-4db7-add0-42133fd57632 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.216775 Sep 16 03:49:39.869294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 95/183] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:39 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:39.974059 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:39.975230 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:39.989978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:39.989978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:39.989978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:39.989978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:39.990345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:39.990345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:40.022783 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:40.023363 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:40.023794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:40.024257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lazy-loading 'fault' on Instance uuid 234c7287-59d4-425c-ba2b-56031d311ee6 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:49:40.083586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:40.097346 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-414944fa-cc66-4d47-8650-0c2d6708197d tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1350 microversion: 2.1 time: 0.127232 Sep 16 03:49:40.103376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 89/184] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:39 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:40.883341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:40.883931 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:40.890545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:40.892178 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:40.893360 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:40.893783 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:40.894346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:40.896776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:40.897222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:41.126672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:41.127360 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:41.139915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:41.140495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:41.144443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:41.145439 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:41.146298 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:41.146938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:41.172531 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:41.180614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-be5b54eb-4dd5-4c70-9daa-bc0b13723a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.300959 Sep 16 03:49:41.181165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 96/185] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:40 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:41.192433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:41.192916 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:41.193350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:41.193798 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lazy-loading 'fault' on Instance uuid 234c7287-59d4-425c-ba2b-56031d311ee6 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:49:41.242277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e4846769d44451b239dee5c892b5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd39c13d4012549c2890bf1d904d1c041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:41.252459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-881ad66c-5cc6-4a81-8425-609d44411443 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 200 len: 1350 microversion: 2.1 time: 0.130985 Sep 16 03:49:41.253032 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 90/186] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:41 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:49:42.206014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:42.206747 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:42.222722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:42.224161 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:42.224161 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:42.224665 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:42.225117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:42.225537 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:42.276161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:42.276905 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:42.284215 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:42.284797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:42.285304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:42.286107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:42.286625 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:42.287180 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:42.303269 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] HTTP exception thrown: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Request method failure captured: Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 HTTP/1.1 Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMtdrrNIfJVjuB4RaOlLjV2XwIqhnYCq9AE1ZWT9DnCwZnwCCqqLhyiw5QNN7oLyBrFqo75GHlAKXj7BPu0QIFPcepNnqBnB_Enzea8oUkJg4GMjSnJhcT5HDZrgL6nOTMeIW_Lee6biu7q6Tolleb1-aZEh96ooDFTPfh9NkKQYo Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: d39c13d4012549c2890bf1d904d1c041 Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:49:42.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d39c13d4012549c2890bf1d904d1c041"}]}] Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: d39c13d4012549c2890bf1d904d1c041 Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-DeleteServersTestJSON-988979524-project Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: c1e4846769d44451b239dee5c892b5e8 Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-DeleteServersTestJSON-988979524-project Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '234c7287-59d4-425c-ba2b-56031d311ee6'} Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:42.316832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.320722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.322632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Returning 404 to user: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:42.322632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6467b106-4d07-45f7-8243-af61cafca7d5 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 404 len: 111 microversion: 2.1 time: 0.038275 Sep 16 03:49:42.322632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 91/187] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:42 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 03:49:42.397380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:42.405624 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-afe94635-86ea-4ff0-a004-32248c77d8bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.204400 Sep 16 03:49:42.406949 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 97/188] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:42 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:42.454345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:42.456623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:42.463621 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:42.464104 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:42.464538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:42.465230 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:42.465687 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:42.469453 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:42.492867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] HTTP exception thrown: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Request method failure captured: Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6/os-volume_attachments HTTP/1.1 Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMtdrrNIfJVjuB4RaOlLjV2XwIqhnYCq9AE1ZWT9DnCwZnwCCqqLhyiw5QNN7oLyBrFqo75GHlAKXj7BPu0QIFPcepNnqBnB_Enzea8oUkJg4GMjSnJhcT5HDZrgL6nOTMeIW_Lee6biu7q6Tolleb1-aZEh96ooDFTPfh9NkKQYo Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: d39c13d4012549c2890bf1d904d1c041 Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:49:42.498105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d39c13d4012549c2890bf1d904d1c041"}]}] Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: d39c13d4012549c2890bf1d904d1c041 Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-DeleteServersTestJSON-988979524-project Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: c1e4846769d44451b239dee5c892b5e8 Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-DeleteServersTestJSON-988979524-project Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.504148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '234c7287-59d4-425c-ba2b-56031d311ee6'} Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:42.504935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:42.506246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:42.507466 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Returning 404 to user: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:42.507466 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f1c53818-1091-4d31-93ba-ade648b23175 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050640 Sep 16 03:49:42.507466 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 92/189] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:49:42 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:49:43.432386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:43.433091 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:43.440850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:43.441330 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:43.441762 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:43.442462 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:43.442991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:43.443421 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:43.574160 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:43.582692 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fcf618f0-2004-4b44-b571-10d44620acc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.154459 Sep 16 03:49:43.583302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 98/190] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:43 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:43.917026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:43.917525 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:43.919601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=51 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:43.924264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:43.924748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:43.925185 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:43.925866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:43.926312 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:43.926729 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:43.942706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] HTTP exception thrown: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Request method failure captured: Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 HTTP/1.1 Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMtdrrNIfJVjuB4RaOlLjV2XwIqhnYCq9AE1ZWT9DnCwZnwCCqqLhyiw5QNN7oLyBrFqo75GHlAKXj7BPu0QIFPcepNnqBnB_Enzea8oUkJg4GMjSnJhcT5HDZrgL6nOTMeIW_Lee6biu7q6Tolleb1-aZEh96ooDFTPfh9NkKQYo Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: d39c13d4012549c2890bf1d904d1c041 Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:49:43.944282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d39c13d4012549c2890bf1d904d1c041"}]}] Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: d39c13d4012549c2890bf1d904d1c041 Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-DeleteServersTestJSON-988979524-project Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: c1e4846769d44451b239dee5c892b5e8 Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-DeleteServersTestJSON-988979524-project Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:43.947711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '234c7287-59d4-425c-ba2b-56031d311ee6'} Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:43.948601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:43.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:43.952341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Returning 404 to user: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:43.952341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-63495b9f-2822-4bc4-89ee-b9bd732b0f8e tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "DELETE /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 404 len: 111 microversion: 2.1 time: 0.032762 Sep 16 03:49:43.952341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 93/191] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:49:43 2022] DELETE /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:49:43.957774 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:43.958395 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] [instance: 234c7287-59d4-425c-ba2b-56031d311ee6] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:43.964677 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:43.965257 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:43.965667 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:43.967153 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:43.967607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:43.968109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:43.989115 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] HTTP exception thrown: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Request method failure captured: Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 HTTP/1.1 Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMtdrrNIfJVjuB4RaOlLjV2XwIqhnYCq9AE1ZWT9DnCwZnwCCqqLhyiw5QNN7oLyBrFqo75GHlAKXj7BPu0QIFPcepNnqBnB_Enzea8oUkJg4GMjSnJhcT5HDZrgL6nOTMeIW_Lee6biu7q6Tolleb1-aZEh96ooDFTPfh9NkKQYo Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: d39c13d4012549c2890bf1d904d1c041 Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:49:43.999045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d39c13d4012549c2890bf1d904d1c041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d39c13d4012549c2890bf1d904d1c041"}]}] Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: d39c13d4012549c2890bf1d904d1c041 Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-DeleteServersTestJSON-988979524 Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-DeleteServersTestJSON-988979524-project Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: c1e4846769d44451b239dee5c892b5e8 Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-DeleteServersTestJSON-988979524-project Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:44.000500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '234c7287-59d4-425c-ba2b-56031d311ee6'} Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:44.001272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. Sep 16 03:49:44.002557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:44.003675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] Returning 404 to user: Instance 234c7287-59d4-425c-ba2b-56031d311ee6 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:44.003675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9de7352a-d95b-4f02-a8a1-8297baecf613 tempest-DeleteServersTestJSON-988979524 tempest-DeleteServersTestJSON-988979524-project] 10.222.0.49 "GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6" status: 404 len: 111 microversion: 2.1 time: 0.047024 Sep 16 03:49:44.003675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 99/192] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:43 2022] GET /compute/v2.1/servers/234c7287-59d4-425c-ba2b-56031d311ee6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:49:44.610346 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:44.611202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:44.618203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:44.618864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:44.619430 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:44.620227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:44.621078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:44.621626 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:44.786282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:44.811837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e198590e-22ff-4dfe-a1cd-c1a68a5fd578 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.205955 Sep 16 03:49:44.812480 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 94/193] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:44 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:45.836844 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:45.837535 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:45.844887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:45.845519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:45.846207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:45.847131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:45.847797 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:45.848221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:45.873962 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:46.014676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:46.023556 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-00d4e3c1-7735-4379-a3ef-f48be53726fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.190978 Sep 16 03:49:46.024694 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 100/194] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:45 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:47.048518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:47.049198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:47.055579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:47.056048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:47.056486 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:47.057163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:47.057605 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:47.058022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:47.265824 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:47.274087 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1fb58217-ebaf-4251-bf83-e4312fa2a8fc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.230159 Sep 16 03:49:47.274666 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 95/195] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:47 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:48.302492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:48.303136 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:48.305675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:48.311832 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:48.312227 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:48.312840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:48.314897 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:48.315410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:48.315831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:48.507074 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:48.511970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cab36985-277e-4e9e-a333-a7ceab1292ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.213893 Sep 16 03:49:48.522966 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 101/196] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:48 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:49.538256 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:49.538873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:49.544870 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:49.545343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:49.545858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:49.546534 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:49.547001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:49.547413 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:49.688977 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:49.697029 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5d9e06bf-4272-4051-ad27-d4f6701f9332 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.162645 Sep 16 03:49:49.697612 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 96/197] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:49 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:50.523625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69dd5691-1ca3-4e04-bfb9-6a52df39a2a4 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Action: 'create', calling method: .version_select at 0x7fba7c8371f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-91888540", "metadata": {"Type": "work"}}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69dd5691-1ca3-4e04-bfb9-6a52df39a2a4 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Request method failure captured: Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 120 Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_JeCvMEVPwu2YY5rZM4GKs-ydjPQHn9OVXqSyMJk6cNsMpsA7YRuI7N4Gh7xAdeg5n9O1SyZ4KvFx4yVViXLTGjPWEH6dmLuv8fuIRVeJ6qQqKmEeUffRN30ZKUB20VgXeV4TYPy4o74WQkUTDu-K-Lxagbzi4zrjmQQvqIjqu9zmA Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:49:50.544266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}] Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: b75c91b3cf4140fe8e32b9c40e2710ca Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-91888540", "metadata": {"Type": "work"}}} Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: Sep 16 03:49:50.545775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-91888540', 'metadata': {'Type': 'work'}}}} Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise error Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi '#$%' Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:50.546704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 03:49:50.548255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 03:49:50.549301 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 03:49:50.549301 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.549301 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69dd5691-1ca3-4e04-bfb9-6a52df39a2a4 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:50.549301 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-69dd5691-1ca3-4e04-bfb9-6a52df39a2a4 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149531 Sep 16 03:49:50.549301 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 102/198] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Sep 16 03:49:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:49:50.557661 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f3216d9-c493-4f83-8c35-9a79013617df tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Action: 'create', calling method: .version_select at 0x7fba7c8c8f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1490687532", "metadata": {"Type": "work"}}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f3216d9-c493-4f83-8c35-9a79013617df tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Request method failure captured: Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 120 Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_JeCvMEVPwu2YY5rZM4GKs-ydjPQHn9OVXqSyMJk6cNsMpsA7YRuI7N4Gh7xAdeg5n9O1SyZ4KvFx4yVViXLTGjPWEH6dmLuv8fuIRVeJ6qQqKmEeUffRN30ZKUB20VgXeV4TYPy4o74WQkUTDu-K-Lxagbzi4zrjmQQvqIjqu9zmA Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:49:50.562762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}] Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: b75c91b3cf4140fe8e32b9c40e2710ca Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1490687532", "metadata": {"Type": "work"}}} Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: Sep 16 03:49:50.564393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1490687532', 'metadata': {'Type': 'work'}}}} Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise error Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi '0' Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:50.565243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 03:49:50.566736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 03:49:50.568014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 03:49:50.568014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.568014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f3216d9-c493-4f83-8c35-9a79013617df tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:50.568014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2f3216d9-c493-4f83-8c35-9a79013617df tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012507 Sep 16 03:49:50.568014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 97/199] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Sep 16 03:49:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:49:50.574187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e484547-5f2b-47e4-95cb-011ca757cdd5 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Action: 'create', calling method: .version_select at 0x7fba7c83b4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-406295096", "metadata": {"Type": "work"}}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e484547-5f2b-47e4-95cb-011ca757cdd5 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Request method failure captured: Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 118 Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_JeCvMEVPwu2YY5rZM4GKs-ydjPQHn9OVXqSyMJk6cNsMpsA7YRuI7N4Gh7xAdeg5n9O1SyZ4KvFx4yVViXLTGjPWEH6dmLuv8fuIRVeJ6qQqKmEeUffRN30ZKUB20VgXeV4TYPy4o74WQkUTDu-K-Lxagbzi4zrjmQQvqIjqu9zmA Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:49:50.579614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}] Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: b75c91b3cf4140fe8e32b9c40e2710ca Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-406295096", "metadata": {"Type": "work"}}} Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: Sep 16 03:49:50.581114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-406295096', 'metadata': {'Type': 'work'}}}} Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise error Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi '' Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:50.582100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 03:49:50.586617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 03:49:50.587857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 03:49:50.587857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.587857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e484547-5f2b-47e4-95cb-011ca757cdd5 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:50.587857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3e484547-5f2b-47e4-95cb-011ca757cdd5 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010701 Sep 16 03:49:50.587857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 103/200] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Sep 16 03:49:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:49:50.594454 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1b23f66e-c9db-41a2-918e-53c874cd787f tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Calling method '.version_select at 0x7fba7c86c8b0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:50.622739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-1b23f66e-c9db-41a2-918e-53c874cd787f tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] HTTP exception thrown: Volume tempest-invalid-1093685073 could not be found. Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1b23f66e-c9db-41a2-918e-53c874cd787f tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Request method failure captured: Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1093685073 HTTP/1.1 Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_JeCvMEVPwu2YY5rZM4GKs-ydjPQHn9OVXqSyMJk6cNsMpsA7YRuI7N4Gh7xAdeg5n9O1SyZ4KvFx4yVViXLTGjPWEH6dmLuv8fuIRVeJ6qQqKmEeUffRN30ZKUB20VgXeV4TYPy4o74WQkUTDu-K-Lxagbzi4zrjmQQvqIjqu9zmA Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:49:50.627203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}] Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: b75c91b3cf4140fe8e32b9c40e2710ca Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Volume tempest-invalid-1093685073 could not be found. Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'tempest-invalid-1093685073'} Sep 16 03:49:50.628660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1093685073 could not be found. (HTTP 404) (Request-ID: req-cc91cce3-6580-43fa-971f-128fb193cde5) Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.629540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 03:49:50.630835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1093685073 could not be found. Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:49:50.632121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1093685073 could not be found. Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1093685073 could not be found. Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1b23f66e-c9db-41a2-918e-53c874cd787f tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Returning 404 to user: Volume tempest-invalid-1093685073 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1b23f66e-c9db-41a2-918e-53c874cd787f tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1093685073" status: 404 len: 99 microversion: 2.1 time: 0.038570 Sep 16 03:49:50.633471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 98/201] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 16 03:49:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1093685073 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 03:49:50.639705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bcf4e558-85bf-4952-8f9c-86dc476aaa6f tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004945 Sep 16 03:49:50.645421 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 104/202] 10.222.0.49 () {58 vars in 1140 bytes} [Fri Sep 16 03:49:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 03:49:50.652649 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7c92e3fb-ce3c-4412-9428-8482b371c844 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003655 Sep 16 03:49:50.653212 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 99/203] 10.222.0.49 () {58 vars in 1137 bytes} [Fri Sep 16 03:49:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 03:49:50.661942 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e08f64ec-30c7-4737-94a8-ed1f867f75f8 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Calling method '.version_select at 0x7fba7c98bee0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:50.692698 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-e08f64ec-30c7-4737-94a8-ed1f867f75f8 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] HTTP exception thrown: Volume 314ae791-ff0e-41c9-9cb4-8b2f2e57d978 could not be found. Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e08f64ec-30c7-4737-94a8-ed1f867f75f8 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Request method failure captured: Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/os-volumes/314ae791-ff0e-41c9-9cb4-8b2f2e57d978 HTTP/1.1 Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_JeCvMEVPwu2YY5rZM4GKs-ydjPQHn9OVXqSyMJk6cNsMpsA7YRuI7N4Gh7xAdeg5n9O1SyZ4KvFx4yVViXLTGjPWEH6dmLuv8fuIRVeJ6qQqKmEeUffRN30ZKUB20VgXeV4TYPy4o74WQkUTDu-K-Lxagbzi4zrjmQQvqIjqu9zmA Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:49:50.694718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}] Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: b75c91b3cf4140fe8e32b9c40e2710ca Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Volume 314ae791-ff0e-41c9-9cb4-8b2f2e57d978 could not be found. Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '314ae791-ff0e-41c9-9cb4-8b2f2e57d978'} Sep 16 03:49:50.696207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 314ae791-ff0e-41c9-9cb4-8b2f2e57d978 could not be found. (HTTP 404) (Request-ID: req-5d83e46e-101f-4cfc-bc73-552313bb1433) Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.697065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 03:49:50.698302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 314ae791-ff0e-41c9-9cb4-8b2f2e57d978 could not be found. Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 03:49:50.699560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 314ae791-ff0e-41c9-9cb4-8b2f2e57d978 could not be found. Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 314ae791-ff0e-41c9-9cb4-8b2f2e57d978 could not be found. Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e08f64ec-30c7-4737-94a8-ed1f867f75f8 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Returning 404 to user: Volume 314ae791-ff0e-41c9-9cb4-8b2f2e57d978 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e08f64ec-30c7-4737-94a8-ed1f867f75f8 tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/314ae791-ff0e-41c9-9cb4-8b2f2e57d978" status: 404 len: 109 microversion: 2.1 time: 0.038685 Sep 16 03:49:50.701467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 105/204] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:49:50 2022] DELETE /compute/v2.1/os-volumes/314ae791-ff0e-41c9-9cb4-8b2f2e57d978 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:49:50.713552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-09361c0a-b273-4bb9-82c1-137dde219afe tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Calling method '.version_select at 0x7fba7c8c8c10>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:50.721828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:50.722619 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:50.729252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:50.729743 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:50.730181 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:50.730880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:50.731465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:50.731884 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:50.742118 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-09361c0a-b273-4bb9-82c1-137dde219afe tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] HTTP exception thrown: Volume 504fbff8-6597-49b9-ae3d-0d0a83f9deb6 could not be found. Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-09361c0a-b273-4bb9-82c1-137dde219afe tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Request method failure captured: Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/os-volumes/504fbff8-6597-49b9-ae3d-0d0a83f9deb6 HTTP/1.1 Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_JeCvMEVPwu2YY5rZM4GKs-ydjPQHn9OVXqSyMJk6cNsMpsA7YRuI7N4Gh7xAdeg5n9O1SyZ4KvFx4yVViXLTGjPWEH6dmLuv8fuIRVeJ6qQqKmEeUffRN30ZKUB20VgXeV4TYPy4o74WQkUTDu-K-Lxagbzi4zrjmQQvqIjqu9zmA Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:49:50.744105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84c5a63f68f947679e6dfc67cebee374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84c5a63f68f947679e6dfc67cebee374"}]}] Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 84c5a63f68f947679e6dfc67cebee374 Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-1398927707 Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: b75c91b3cf4140fe8e32b9c40e2710ca Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-1398927707-project Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Volume 504fbff8-6597-49b9-ae3d-0d0a83f9deb6 could not be found. Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '504fbff8-6597-49b9-ae3d-0d0a83f9deb6'} Sep 16 03:49:50.745503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 504fbff8-6597-49b9-ae3d-0d0a83f9deb6 could not be found. (HTTP 404) (Request-ID: req-ca3cfbd7-f63a-4ef8-821e-6e5db34d0f9e) Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.746483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:49:50.755924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 504fbff8-6597-49b9-ae3d-0d0a83f9deb6 could not be found. Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 03:49:50.757677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 504fbff8-6597-49b9-ae3d-0d0a83f9deb6 could not be found. Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 504fbff8-6597-49b9-ae3d-0d0a83f9deb6 could not be found. Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-09361c0a-b273-4bb9-82c1-137dde219afe tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] Returning 404 to user: Volume 504fbff8-6597-49b9-ae3d-0d0a83f9deb6 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-09361c0a-b273-4bb9-82c1-137dde219afe tempest-VolumesNegativeTest-1398927707 tempest-VolumesNegativeTest-1398927707-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/504fbff8-6597-49b9-ae3d-0d0a83f9deb6" status: 404 len: 109 microversion: 2.1 time: 0.036743 Sep 16 03:49:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 100/205] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:49:50 2022] GET /compute/v2.1/os-volumes/504fbff8-6597-49b9-ae3d-0d0a83f9deb6 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:49:50.869653 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:50.877730 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0d1f29c7-78c6-430e-a960-a5bdbb6175eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.159756 Sep 16 03:49:50.878295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 106/206] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:50 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:51.903550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:51.904448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:51.911199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:51.911769 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:51.912203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:51.912896 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:51.913341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:51.913763 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:52.053095 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:52.063290 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b2b04ba6-0ed4-4e7b-babd-5f6900a8e3bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.163148 Sep 16 03:49:52.064568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 101/207] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:51 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:53.087197 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:53.087713 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:53.094150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:53.094633 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:53.095102 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:53.095773 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:53.096216 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:53.096630 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:53.251909 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:53.263702 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-31aef377-b62f-4a00-b14e-ea81ab70fdbb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.180393 Sep 16 03:49:53.264255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 107/208] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:53 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:54.286337 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:54.287113 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:54.293012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:54.293845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:54.294288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:54.295180 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:54.295791 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:54.296374 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:54.318040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:54.439047 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:54.447862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bf30a01b-1963-4cd9-aa17-5fa6e04a35f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.165142 Sep 16 03:49:54.448555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 102/209] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:54 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:55.472294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:55.472904 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:55.480414 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:55.480901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:55.481918 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:55.482791 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:55.483353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:55.483794 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:55.616672 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:55.624659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c42efc8-e587-4082-a362-e6df620e9bac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.156256 Sep 16 03:49:55.625220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 108/210] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:55 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:56.646658 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:56.648845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:56.653712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:56.654250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:56.654686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:56.655403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:56.655855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:56.656268 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:56.799235 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:56.809034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4570e16f-db4a-4a56-8d35-cfcb33eb4040 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.166182 Sep 16 03:49:56.810261 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 103/211] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:56 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:57.834364 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:57.835101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:57.841821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:57.842297 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:57.842777 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:57.843487 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:57.843935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:57.844349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:57.980615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:57.991518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0ea7729c-bf1d-4047-a6a1-36ff6efe298f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.161234 Sep 16 03:49:57.993023 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 109/212] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:57 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:49:59.015857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:49:59.016521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:49:59.022402 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:59.022886 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:59.023358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:59.024045 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:49:59.024495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:49:59.024915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:49:59.374577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:49:59.382359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-50ce5021-f309-4c3a-a49c-95b4ecc6aa91 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.370840 Sep 16 03:49:59.382938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 104/213] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:49:59 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:00.406560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:00.407171 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:00.413615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:00.414657 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:00.414657 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:00.415282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:00.415963 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:00.416392 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:00.545085 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:00.553191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-79f5727f-8571-4147-a789-33ac63041a5c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.151314 Sep 16 03:50:00.553758 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 110/214] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:00 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:01.577567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:01.578170 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:01.584124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:01.584600 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:01.585040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:01.585712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:01.586154 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:01.586568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:01.713370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:01.721004 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-87b9150a-bb9b-4eab-977f-666cd3c62a41 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.148148 Sep 16 03:50:01.721579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 105/215] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:01 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:02.744721 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:02.745443 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:02.752696 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:02.753187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:02.753624 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:02.754329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:02.754782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:02.755233 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:02.885129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:02.893381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6cfb2cc7-87a3-411b-b5bb-30fc193bf42d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.152745 Sep 16 03:50:02.893949 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 111/216] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:02 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:03.924822 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:03.925425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:03.931878 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:03.932350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:03.932776 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:03.933460 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:03.933902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:03.934380 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:04.066253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:04.072500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7d1d0a8f-ee7a-42a7-b811-92d15e4937e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.151583 Sep 16 03:50:04.073135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 106/217] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:03 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:05.096598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:05.097203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:05.103758 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:05.104239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:05.104671 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:05.105356 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:05.105803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:05.107259 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:05.236250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:05.244090 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e6872760-49f0-4768-8956-2e20ccef1a8b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.151285 Sep 16 03:50:05.244654 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 112/218] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:05 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:06.267530 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:06.268144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:06.274049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:06.274529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:06.274994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:06.275699 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:06.276132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:06.276557 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:06.407131 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:06.414774 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4b0f85f0-5b13-4296-8705-f04a66f44409 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.151118 Sep 16 03:50:06.415359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 107/219] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:06 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:07.440673 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:07.441275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:07.447893 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:07.448372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:07.448799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:07.449480 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:07.450531 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:07.450973 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:07.582307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:07.591385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-628d7b1c-6a54-4da2-a5f9-11b0114b7967 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1521 microversion: 2.1 time: 0.154016 Sep 16 03:50:07.591972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 113/220] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:07 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:08.617378 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:08.618012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:08.626041 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:08.626541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:08.628181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:08.628991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:08.629467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:08.629899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:08.761213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:08.770049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a8d08fa9-ca7b-49e8-ae37-6b87709af0a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1501 microversion: 2.1 time: 0.158409 Sep 16 03:50:08.770608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 108/221] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:08 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:08.795799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:08.796726 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:08.804297 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:08.804799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:08.805237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:08.805991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:08.806581 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:08.807054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:08.947377 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:08.955146 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6abec71e-e0da-4501-b044-2381c420b991 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1516 microversion: 2.1 time: 0.163473 Sep 16 03:50:08.955709 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 114/222] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:08 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:10.970545 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:10.972935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:10.978864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:10.979382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:10.979821 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:10.980509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:10.981028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:10.981488 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:11.003767 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lazy-loading 'flavor' on Instance uuid 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:50:11.381377 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f90ac843-4c76-4870-b888-f4134f992fc2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d/action" status: 200 len: 32 microversion: 2.1 time: 0.415446 Sep 16 03:50:11.382057 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 109/223] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:50:10 2022] POST /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 03:50:11.393273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:11.394051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:11.400834 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:11.401329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:11.402045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:11.403680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:11.404201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:11.404612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:11.543195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:11.551125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d7aed4ee-cf6b-40b9-b591-8abbbfb65e2b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.162089 Sep 16 03:50:11.551709 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 115/224] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:11 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:12.575556 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:12.576260 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:12.582476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:12.582986 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:12.583420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:12.584103 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:12.584551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:12.584970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:12.713455 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:12.721845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-14bc4434-4297-47a2-b3b4-4ad109895219 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.150943 Sep 16 03:50:12.722397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 110/225] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:12 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:13.396935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1890321941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-752799329", "security_groups": [{"name": "tempest-secgroup-smoke-1957135765"}], "networks": [{"uuid": "854d2c8e-4d81-4bfd-bcba-fb4707dd8cf5"}], "block_device_mapping_v2": [{"uuid": "d26a674e-0041-42aa-873d-73131bbf6445", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:13.617003 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] validate_networks() for [('854d2c8e-4d81-4bfd-bcba-fb4707dd8cf5', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:50:13.745523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:13.746268 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:13.752272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:13.752844 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:13.753292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:13.753966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:13.754411 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:13.754823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:13.897983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:13.905005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0c2ba310-a4a7-4205-92db-5adab5e59d62 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.162729 Sep 16 03:50:13.905881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 111/226] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:13 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:14.160341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:50:14.160793 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:50:14.161258 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:50:14.161948 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:50:14.162358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:50:14.171920 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:14.172396 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:14.172993 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:14.173713 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:14.174167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:14.174588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:14.193080 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Getting quotas for project 37a1aef0396c463d8a10f0ee811e1f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:50:14.197157 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Getting quotas for user ede7a69d69084b3583433547473532be and project 37a1aef0396c463d8a10f0ee811e1f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:50:14.267024 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:50:14.274309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d26a674e-0041-42aa-873d-73131bbf6445',volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:50:14.848961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4e27d813-9387-4435-863c-bdcf37ff8e3a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.455029 Sep 16 03:50:14.856824 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 116/227] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:50:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:50:14.861356 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-28b45c89-62c5-4991-925f-024b23b118a6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:14.862012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-28b45c89-62c5-4991-925f-024b23b118a6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:14.864366 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=30 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:14.929943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-28b45c89-62c5-4991-925f-024b23b118a6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:14.930636 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:14.931652 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:14.938053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-28b45c89-62c5-4991-925f-024b23b118a6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1088 microversion: 2.1 time: 0.080634 Sep 16 03:50:14.938638 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 112/228] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:14 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:14.952631 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:14.953343 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:14.959210 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:14.960974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:14.961813 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:14.962410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:15.116345 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:15.133134 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ef9da6f-22a4-4212-b11d-80c4b16c18f7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.202769 Sep 16 03:50:15.133134 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 117/229] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:14 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:15.962500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ecf93f0f-8a3a-4731-857b-0b2286bc40b0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:15.962500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ecf93f0f-8a3a-4731-857b-0b2286bc40b0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:16.015345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ecf93f0f-8a3a-4731-857b-0b2286bc40b0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:16.024133 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ecf93f0f-8a3a-4731-857b-0b2286bc40b0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1088 microversion: 2.1 time: 0.066519 Sep 16 03:50:16.034061 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 113/230] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:15 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:16.155486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:16.156128 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:16.158419 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:16.163148 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:16.163631 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:16.164063 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:16.164761 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:16.165242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:16.165685 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:16.304226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:16.313225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9dc45269-7d16-4432-bc87-fcc8b2724903 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.162277 Sep 16 03:50:16.314739 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 118/231] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:16 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:17.049568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:17.051476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:17.059716 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:17.060260 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:17.060695 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:17.063912 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:17.063912 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:17.063912 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:17.128909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:17.138005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-66be7f5d-f665-43e1-bd99-d39a23331985 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1186 microversion: 2.1 time: 0.092308 Sep 16 03:50:17.138943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 114/232] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:17 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:17.337936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:17.338546 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:17.351344 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:17.352171 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:17.352850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:17.353558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:17.354140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:17.354580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:17.497799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:17.505812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5d83de81-1ca0-4740-bfcf-c536bddfb758 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.172150 Sep 16 03:50:17.506385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 119/233] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:17 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:18.164427 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:18.165076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:18.172081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:18.172569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:18.175808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:18.175808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:18.175808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:18.175808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:18.239629 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:18.247394 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-96928bd5-3dbc-4363-8f34-148f5ec7efb1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1186 microversion: 2.1 time: 0.086765 Sep 16 03:50:18.247964 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 115/234] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:18 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:18.533457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:18.534066 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:18.541212 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:18.541763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:18.542421 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:18.543144 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:18.544312 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:18.544966 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:18.675109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:18.683193 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-efed8e84-bc0d-461b-a06c-5f7b2a22c280 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.153544 Sep 16 03:50:18.683757 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 120/235] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:18 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:19.269487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:19.270225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:19.276831 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:19.278675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:19.278675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:19.279639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:19.280101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:19.280527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:19.299323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:19.299988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:19.306395 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:19.307143 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:19.307701 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:19.308669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:19.309436 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:19.309952 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:19.338400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2beb5625-f610-4232-9f18-e10b60e0276b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/ips" status: 200 len: 144 microversion: 2.1 time: 0.043300 Sep 16 03:50:19.338995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 121/236] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:50:19 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:50:19.357171 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:19.373692 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-32002e87-cf87-49f8-8c4d-9ef67b6ca380 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1186 microversion: 2.1 time: 0.108017 Sep 16 03:50:19.374278 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 116/237] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:19 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1186 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:19.707268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:19.708125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:19.714866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:19.715968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:19.716450 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:19.717222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:19.717701 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:19.718121 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:19.722251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:20.094364 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:20.100914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ae1e41c6-ec20-4290-b2c8-d22ecf1d1532 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.397524 Sep 16 03:50:20.101571 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 122/238] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:19 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:20.396111 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:20.401102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:20.403730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:20.404319 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:20.404754 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:20.405472 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:20.406023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:20.406449 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:20.478264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:20.486880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-40ee23d5-9c69-4382-b125-0068e6e09f56 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1186 microversion: 2.1 time: 0.094338 Sep 16 03:50:20.487662 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 117/239] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:20 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:21.125228 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:21.125842 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:21.132461 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:21.132991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:21.133426 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:21.137557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:21.137557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:21.137557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:21.273852 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:21.279295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-347f8f0e-1097-4572-9626-d8a826c903f1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.158330 Sep 16 03:50:21.279837 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 123/240] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:21 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:21.509787 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:21.510397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:21.516884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:21.517374 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:21.521849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:21.521849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:21.521849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:21.521849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:21.586610 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:21.596675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b966cc32-04a1-4069-97e8-f37987f6c3bc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1194 microversion: 2.1 time: 0.090589 Sep 16 03:50:21.597255 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 118/241] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:21 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:22.303218 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:22.303827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:22.311138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:22.311637 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:22.312073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:22.312763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:22.313219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:22.313638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:22.464749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:22.476547 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5cd43f11-2189-4483-b454-2c487b2aa738 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.177399 Sep 16 03:50:22.477236 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 124/242] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:22 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:22.621291 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:22.622975 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:22.629452 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:22.630237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:22.630852 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:22.631667 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:22.632117 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:22.632579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:22.636821 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:22.710121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:22.719868 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a7aa7bd4-b13f-4238-b7c5-6f862a4f21be tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1204 microversion: 2.1 time: 0.102789 Sep 16 03:50:22.723670 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 119/243] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:22 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:23.500776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:23.501296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:23.507930 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:23.508552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:23.508821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:23.509512 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:23.510004 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:23.510428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:23.644540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:23.652425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd0656a3-ef2b-4ed6-8f92-3c315f793019 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.155785 Sep 16 03:50:23.653580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 125/244] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:23 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:23.743229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:23.743869 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:23.750355 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:23.750890 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:23.751290 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:23.751978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:23.752418 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:23.752842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:23.819382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:23.833618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-05a07087-e5dc-4e08-aa56-f4ad95cfe03a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1204 microversion: 2.1 time: 0.094052 Sep 16 03:50:23.847077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 120/245] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:23 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1204 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:24.463195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:24.463728 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:24.469891 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:24.470797 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:24.475373 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:24.475815 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:24.476863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:24.477760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:24.478244 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:24.479008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:24.505712 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8a00cf4d-cb4f-4541-a840-d0f3cc8ad40c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/ips" status: 200 len: 150 microversion: 2.1 time: 0.046474 Sep 16 03:50:24.506381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 126/246] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:50:24 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:50:24.680607 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:24.681720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:24.689728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:24.690551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:24.691084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:24.691916 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:24.692460 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:24.692951 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:24.860425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:24.861439 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:24.869705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:24.873645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:24.873645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:24.873645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:24.873645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:24.874176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:24.900385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:24.917862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9cb59aae-a80a-4bc8-9119-9c37e92d6251 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.243896 Sep 16 03:50:24.919140 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 121/247] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:24 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:25.123754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:25.133142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd66a66e-98fa-47d8-8966-34490d65f52e"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:25.134996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:25.136057 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5d4f5b13-5848-4f0a-9495-f5bf5bc6387e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1272 microversion: 2.1 time: 0.281512 Sep 16 03:50:25.137010 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 127/248] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:24 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:25.151430 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:25.156146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:25.156146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:25.156146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:25.156146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:25.156673 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:25.942323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:25.942962 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:25.949396 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:25.950388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:25.950824 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:25.951538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:25.956014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:25.956014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:26.019661 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:26.117242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:26.132729 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0d5dbd18-7958-4ea0-a1e6-2182b6881e47 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.191880 Sep 16 03:50:26.134142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 128/249] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:25 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:26.168419 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:26.170693 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:26.179602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:26.180243 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:26.180846 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:26.181972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:26.182678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:26.183185 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:26.428244 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:26.438201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a7859c96-ca0b-4c96-89f5-3eda7bb4168d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1272 microversion: 2.1 time: 0.274744 Sep 16 03:50:26.438745 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 129/250] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:26 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:26.443308 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-d7930d61-ffc3-4b96-af71-a6b2140bd362 req-477c010e-bbb6-4daf-8110-d05ed1ed133e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d52b03d-e8ff-4942-a9d3-33b7341dad63", "tag": "2c25634f-27f9-4868-a4bb-0f555233fe5e"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:26.453049 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d7930d61-ffc3-4b96-af71-a6b2140bd362 req-477c010e-bbb6-4daf-8110-d05ed1ed133e service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:26.453522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d7930d61-ffc3-4b96-af71-a6b2140bd362 req-477c010e-bbb6-4daf-8110-d05ed1ed133e service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:26.453944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d7930d61-ffc3-4b96-af71-a6b2140bd362 req-477c010e-bbb6-4daf-8110-d05ed1ed133e service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:26.464891 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-d7930d61-ffc3-4b96-af71-a6b2140bd362 req-477c010e-bbb6-4daf-8110-d05ed1ed133e service nova] Creating event network-changed:2c25634f-27f9-4868-a4bb-0f555233fe5e for instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 on hv-cinder-85799 Sep 16 03:50:26.470737 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-d7930d61-ffc3-4b96-af71-a6b2140bd362 req-477c010e-bbb6-4daf-8110-d05ed1ed133e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030720 Sep 16 03:50:26.471368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 130/251] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:50:26.750169 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:26.750745 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:26.757447 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:26.757933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:26.758397 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:26.759231 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:26.759711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:26.760136 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:26.786266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4cff99eb-c27a-4c96-8c2d-06c0e5b86c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/ips" status: 200 len: 151 microversion: 2.20 time: 0.040987 Sep 16 03:50:26.786846 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 131/252] 10.222.0.49 () {60 vars in 1289 bytes} [Fri Sep 16 03:50:26 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:50:27.158803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:27.159470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:27.165718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:27.166203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:27.166632 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:27.167342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:27.167790 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:27.168268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:27.301742 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:27.312243 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e1a4b35f-29ad-4eab-aabc-7a3f49ab4d32 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.157109 Sep 16 03:50:27.319002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 132/253] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:27 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:27.461704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:27.462311 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:27.469648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:27.470155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:27.470638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:27.471419 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:27.471862 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:27.472351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:27.618588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:27.628415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9464ecaa-dc7e-4ae3-a832-ac56df66718a tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.170654 Sep 16 03:50:27.629187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 133/254] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:27 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:28.336333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:28.336937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:28.343931 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:28.344407 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:28.344834 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:28.345512 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:28.345959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:28.346375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:28.482197 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:28.490960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3c6a3357-c19f-46d9-a4e1-e5ca3ef869f4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.158223 Sep 16 03:50:28.491549 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 134/255] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:28 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:28.653789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:28.654478 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:28.661140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:28.661713 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:28.662149 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:28.662868 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:28.663431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:28.663880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:28.801811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:28.809760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-490327e6-0722-4537-aad2-c162bbccb858 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.161006 Sep 16 03:50:28.810325 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 135/256] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:28 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:29.517101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:29.517903 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:29.527379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:29.530334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:29.530334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:29.530334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:29.530334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:29.530932 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:29.682665 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:29.691291 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bbe031a9-ba59-4461-b7bd-5aeec6aa2715 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.178432 Sep 16 03:50:29.691850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 136/257] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:29 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:29.832651 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:29.833263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:29.839399 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:29.839884 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:29.840877 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:29.841577 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:29.842026 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:29.842455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:29.971465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4a06c270-47c7-4689-a54f-1a0768e6a0b9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.845276 Sep 16 03:50:29.972440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 122/258] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:50:25 2022] POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/os-volume_attachments => generated 194 bytes in 4847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:50:29.989351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:29.997190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a41eb773-e8a3-49b3-8826-4986300a33ac tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.168450 Sep 16 03:50:30.002478 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 137/259] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:29 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:30.724776 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:30.725501 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:30.732763 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:30.734145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:30.734145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:30.735396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:30.735396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:30.736193 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:30.893320 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:30.901682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7b9aa4f3-0e77-4cab-87ea-a6ae837ab3a8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.181946 Sep 16 03:50:30.902274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 123/260] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:30 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:31.024052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:31.024607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:31.031275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:31.031744 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:31.032173 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:31.032849 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:31.033294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:31.033709 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:31.170045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:31.178526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-abe46317-7b91-4da1-a8c6-c4e85a6ce2cc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.158252 Sep 16 03:50:31.179129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 138/261] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:31 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:31.925443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:31.926051 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:31.932754 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:31.933229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:31.933656 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:31.934988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:31.935453 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:31.935869 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:32.066771 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:32.074655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-03166ef3-2761-4ea5-a20b-14cfc3c932f0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.152959 Sep 16 03:50:32.075408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 124/262] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:31 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:32.201590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:32.202273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:32.208626 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:32.215951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:32.215951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:32.215951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:32.215951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:32.216503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:32.345135 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:32.352877 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb4e1640-1740-41e0-a1df-8693abb9d1c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.155140 Sep 16 03:50:32.353468 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 139/263] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:32 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:33.103647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:33.104298 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:33.115521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:33.116039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:33.116659 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:33.117372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:33.117826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:33.118244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:33.276742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:33.287101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-09735162-4f4a-47b2-8edc-f52ea8fe4768 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.192870 Sep 16 03:50:33.288050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 125/264] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:33 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:33.379685 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:33.380210 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:33.386681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:33.387448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:33.387888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:33.388588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:33.389076 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:33.389500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:33.393978 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:33.563103 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:33.572499 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-74b74d5c-768c-4f8a-a072-1daa55c77126 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.199018 Sep 16 03:50:33.573114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 140/265] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:33 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:33.716622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0251c7e9-57b2-4f1b-bff8-a921825d1e56"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:33.718329 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:33.725174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:33.725746 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:33.726242 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:33.727527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:33.732459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:33.732459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:34.314863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:34.315612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:34.321633 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:34.322119 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:34.322551 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:34.323437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:34.323895 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:34.324319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:34.603120 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:34.611469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0ee78e4d-e55c-4da5-8878-38921eb45fbc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.300479 Sep 16 03:50:34.612039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 141/266] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:34 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:34.616413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:34.617014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:34.624032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:34.624521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:34.625030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:34.625738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:34.626188 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:34.626709 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:34.764447 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:34.772598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c651db33-2e44-4c79-b46e-b9581025d372 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.159605 Sep 16 03:50:34.773369 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 142/267] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:34 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:35.642299 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:35.642993 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:35.649767 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:35.650250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:35.650682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:35.651446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:35.651900 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:35.652356 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:35.806479 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:35.816161 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e8b57e10-57cf-4be5-92aa-3389efe8639a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.177968 Sep 16 03:50:35.816817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 143/268] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:35 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:35.821904 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:35.822661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:35.829296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:35.829859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:35.830339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:35.831143 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:35.831622 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:35.832317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:35.990249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:36.001256 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-67b37b70-aa68-4495-bdd6-61d93f2da353 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.183163 Sep 16 03:50:36.002307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 144/269] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:35 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:36.523618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f9b224ea-64fc-4b15-be51-8d0e1ba012ea tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.814425 Sep 16 03:50:36.524330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 126/270] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:50:33 2022] POST /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments => generated 194 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:50:36.839679 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:36.840349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:36.847191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:36.847677 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:36.848112 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:36.848821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:36.849253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:36.849677 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:36.927031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:36.927716 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:36.934819 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:36.935363 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:36.935797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:36.936504 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:36.936958 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:36.937378 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:36.962328 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lazy-loading 'flavor' on Instance uuid 230b59e9-09d0-4448-a6a6-a395823fcd8b {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:50:36.982925 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:36.990884 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0c621fd8-c4d7-451d-9adc-1a8b33eb8bda tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.155085 Sep 16 03:50:36.991726 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 145/271] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:36 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:37.024409 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:37.025021 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:37.031557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:37.032018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:37.032447 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:37.033520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:37.033632 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:37.034834 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:37.172295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:37.181670 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7b3cfc0b-bd46-47e9-beff-d23ec09de2e6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.161224 Sep 16 03:50:37.182389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 146/272] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:37 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:37.541738 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-863349e3-b00b-4e3e-b9fb-d35504559bee tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/action" status: 202 len: 0 microversion: 2.20 time: 0.619267 Sep 16 03:50:37.542465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 127/273] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Sep 16 03:50:36 2022] POST /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 03:50:37.551717 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:37.552518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:37.560274 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:37.560765 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:37.561196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:37.562676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:37.563047 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:37.564112 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:37.718181 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:37.726420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:37.727875 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:37.729023 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-02134eb8-033e-44af-a243-dfad09b0ee16 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.182024 Sep 16 03:50:37.729589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 147/274] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:37 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:38.018428 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:38.019141 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:38.025969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:38.026440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:38.026866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:38.028130 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:38.028761 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:38.029185 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:38.161475 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:38.171406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-db3e531a-31e1-43bc-ac1a-922f8338adb7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.157547 Sep 16 03:50:38.172080 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 128/275] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:38 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:38.205762 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:38.206371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:38.212807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:38.213286 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:38.213716 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:38.214389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:38.214832 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:38.215765 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:38.360634 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:38.368427 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-792f9c8f-ace3-404e-85ad-a55eb0f82f02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.166643 Sep 16 03:50:38.368982 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 148/276] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:38 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:38.755737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:38.756393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:38.762247 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:38.762750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:38.763206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:38.763889 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:38.764465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:38.764866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:38.893618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:38.901653 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:38.903845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:38.905301 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-405e64db-5a31-4bbc-87da-fc66ec525821 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.153272 Sep 16 03:50:38.905850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 129/277] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:38 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:39.197996 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:39.198605 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:39.205442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:39.206018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:39.206586 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:39.207069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:39.207520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:39.207944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:39.341386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:39.349290 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ef4381f0-7a17-41ee-8647-550dd83ba231 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.155195 Sep 16 03:50:39.349859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 149/278] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:39 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:39.394492 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:39.395133 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:39.401706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:39.402192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:39.402648 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:39.403470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:39.403963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:39.404467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:39.543928 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:39.551731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8984f513-738b-4393-8fad-7046ac08e136 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.161076 Sep 16 03:50:39.552296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 130/279] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:39 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:39.931592 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:39.932199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:39.938324 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:39.938808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:39.939270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:39.939954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:39.940399 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:39.940814 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:40.084037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:40.092840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:40.094289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:40.095481 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ab29d63b-574f-44b5-8a92-b95713c68411 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.168262 Sep 16 03:50:40.096033 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 150/280] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:39 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:40.378570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:40.379692 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:40.387494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:40.388487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:40.389052 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:40.390148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:40.390671 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:40.391129 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:40.395530 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:40.575638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:40.576282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:40.582850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:40.583279 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:40.583710 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:40.584405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:40.584850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:40.585269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:40.739155 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:40.748292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6a6971e6-522b-4882-838f-45f530286fb6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.374725 Sep 16 03:50:40.749632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 131/281] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:40 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:40.756555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:40.766149 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1ac776e4-308c-4b16-8ddf-8a4bf384971d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.194964 Sep 16 03:50:40.779099 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 151/282] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:40 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:41.122493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:41.123057 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:41.129398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:41.129881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:41.133157 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:41.133157 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:41.133157 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:41.133157 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:41.266877 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:41.275028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:41.276516 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:41.278364 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-27e0bd3d-7281-4182-8191-84b38ccebf18 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.159787 Sep 16 03:50:41.278941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 132/283] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:41 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:41.772300 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:41.772918 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:41.780576 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:41.781062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:41.781497 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:41.782195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:41.782642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:41.783314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:41.792392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:41.794289 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:41.801159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:41.801617 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:41.802063 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:41.802734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:41.803483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:41.803896 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:41.950174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:41.958890 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9249871a-7f6f-46e8-bb60-19b46891734b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.170576 Sep 16 03:50:41.959487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 133/284] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:41 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:42.032068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:42.040880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eaca34be-ff86-47d9-b68b-1f7fbedf04b6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.273144 Sep 16 03:50:42.041453 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 152/285] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:41 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:42.303647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:42.304182 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:42.310102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:42.310613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:42.311078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:42.311768 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:42.312224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:42.312644 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:42.447457 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:42.456550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:42.458293 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:42.459646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3f8e3711-9535-4596-9d9e-d56ff6caaf6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.160206 Sep 16 03:50:42.460599 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 134/286] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:42 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:42.985052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:42.985794 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:43.010760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:43.010760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:43.017586 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:43.018588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:43.019095 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:43.019558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:43.070393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:43.072740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:43.081800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:43.082292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:43.082727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:43.083469 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:43.083923 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:43.084347 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:43.194863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:43.203542 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4c8e50ae-b376-4a78-98b3-6638c95e33cf tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.223369 Sep 16 03:50:43.214051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 153/287] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:42 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:43.231214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:43.238933 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fdf19229-dc1a-464a-8826-989ed3ff3ec4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.174145 Sep 16 03:50:43.239509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 135/288] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:43 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:43.485869 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:43.486502 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:43.492370 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:43.492842 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:43.493269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:43.493939 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:43.494431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:43.494845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:43.635782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:43.644311 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:43.645903 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:43.647099 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b1767353-89d4-481b-9553-5f28979b4a88 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.165273 Sep 16 03:50:43.647652 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 154/289] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:43 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:44.227175 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:44.227893 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:44.234688 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:44.235212 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:44.235645 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:44.236417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:44.236875 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:44.237354 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:44.263361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:44.264035 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:44.270856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:44.271814 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:44.276327 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:44.276327 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:44.276327 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:44.276327 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:44.420760 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:44.431653 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-96460e56-e08a-41dd-8051-17b54755082d tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.208469 Sep 16 03:50:44.432457 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 136/290] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:44 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:44.473309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:44.482454 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bfc20218-289f-478a-8e06-ffbfdbf1ebfc tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.223733 Sep 16 03:50:44.483040 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 155/291] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:44 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:44.676559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:44.677211 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:44.683372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:44.684527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:44.684958 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:44.685636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:44.686082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:44.686505 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:44.907790 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:44.917073 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:44.919253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:44.920510 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7224ec9e-0d52-4497-9e30-9d817ea5bee4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.247830 Sep 16 03:50:44.930995 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 137/292] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:44 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:45.457003 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:45.459837 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:45.465963 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:45.466688 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:45.467389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:45.468910 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:45.468910 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:45.469236 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:45.508351 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:45.510380 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:45.520856 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:45.521464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:45.522181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:45.523188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:45.523432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:45.523797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:45.636309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:45.639909 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:45.644489 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-22f51f45-94c5-4191-9ad6-4285c6f01006 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.191622 Sep 16 03:50:45.645061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 156/293] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:45 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:45.744800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:45.753172 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7ef63a10-cd47-4c37-a825-0f6a9f194f99 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.250952 Sep 16 03:50:45.753728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 138/294] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:45 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:45.947189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:45.947823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:45.958013 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:45.959524 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:45.960309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:45.961802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:45.962393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:45.963048 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:46.108428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:46.116702 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:46.118391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:46.119612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb3869ee-3324-42f2-9bd9-61f2af68d218 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.176439 Sep 16 03:50:46.120150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 157/295] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:45 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:46.667496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:46.668684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:46.671393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=58 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:46.676297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:46.676803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:46.677266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:46.677969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:46.678807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:46.679288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:46.776490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:46.778791 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:46.785398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:46.786109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:46.786539 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:46.787255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:46.787700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:46.788116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:46.814823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:46.821532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10695202-85bc-4599-a147-14b322a5c012 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.158072 Sep 16 03:50:46.822095 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 139/296] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:46 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:46.930621 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:46.938568 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-650a0283-0be4-4707-85be-3efd7ea4befd tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1502 microversion: 2.1 time: 0.165889 Sep 16 03:50:46.939164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 158/297] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:46 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:46.969188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b738e48-9eb2-49c0-9207-1303565d03ee"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:46.971654 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:46.978329 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:46.978797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:46.979416 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:46.980257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:46.981044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:46.981652 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.005098 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] HTTP exception thrown: Cannot 'attach_volume' instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d while it is in vm_state rescued Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Request method failure captured: Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d/os-volume_attachments HTTP/1.1 Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 74 Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IQJXyFJdHaMqBjeHrrX6Vc1xzZgD1ImELyXYJrUZwdAsqBKD1-4JJwShHN6JJiLxATqXwbGbUt4LTiPZxdSHBtKReRq2iPr19u7dHdT0PEwFAbTNlt9KE6AsRMQTcqEFePru42CEaC430wnwaGuQ5QX4fLiSO4iDxqHDBTRWlT8Yg Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:50:47.006781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}] Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: a6b29b9086f64ea7a7990572567642f7 Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {"volumeAttachment": {"volumeId": "9b738e48-9eb2-49c0-9207-1303565d03ee"}} Sep 16 03:50:47.008227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Cannot 'attach_volume' instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d while it is in vm_state rescued Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '3ea00b9d-1f8f-4428-98f7-9d66fd079c6d', 'body': {'volumeAttachment': {'volumeId': '9b738e48-9eb2-49c0-9207-1303565d03ee'}}} Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:50:47.013353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d while it is in vm_state rescued Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:50:47.014902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:50:47.020373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:50:47.020373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:50:47.020373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d while it is in vm_state rescued Sep 16 03:50:47.020373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:50:47.020373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Returning 409 to user: Cannot 'attach_volume' instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d while it is in vm_state rescued {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:50:47.020373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7cfd6071-f812-4d94-9b75-db6ddac37a00 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043813 Sep 16 03:50:47.020373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 140/298] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:50:46 2022] POST /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 03:50:47.021848 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:47.021848 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:47.024881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:47.025374 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:47.025810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.026550 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:47.027045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:47.028179 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.146057 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:47.146659 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:47.152792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:47.153365 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:47.153797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.154573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:47.155078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:47.155497 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.295522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:47.303823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:47.305267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:47.306421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-85b63fb1-efcb-4725-a907-8824ff576976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.164414 Sep 16 03:50:47.307184 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 141/299] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:47 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:50:47.312127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1eb31b31-36f6-4e1e-a8b2-60216d5899a9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.297462 Sep 16 03:50:47.313390 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 159/300] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:50:47 2022] POST /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:50:47.329330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:47.330228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:47.337827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:47.337827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:47.338101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.338816 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:47.339286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:47.339975 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.476955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:47.485939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cf14579a-6795-4764-bcb1-a8aa0d56355f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1510 microversion: 2.1 time: 0.162538 Sep 16 03:50:47.486623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 142/301] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:47 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:47.846085 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:47.848549 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:47.853283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:47.853778 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:47.854215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.854937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:47.855385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:47.855810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:47.999794 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:48.007472 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-84eb2a81-d574-44b7-adcd-1e47e0bcd44f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.165793 Sep 16 03:50:48.008263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 160/302] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:47 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:48.216040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-d62ec4c1-23e2-4ab9-a2f7-36f46d5a60c8 req-3464219a-97a4-459e-9b2c-301cadba5e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d52b03d-e8ff-4942-a9d3-33b7341dad63", "name": "network-vif-plugged", "status": "completed", "tag": "2c25634f-27f9-4868-a4bb-0f555233fe5e"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:48.228675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d62ec4c1-23e2-4ab9-a2f7-36f46d5a60c8 req-3464219a-97a4-459e-9b2c-301cadba5e42 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:48.229195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d62ec4c1-23e2-4ab9-a2f7-36f46d5a60c8 req-3464219a-97a4-459e-9b2c-301cadba5e42 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:48.229815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d62ec4c1-23e2-4ab9-a2f7-36f46d5a60c8 req-3464219a-97a4-459e-9b2c-301cadba5e42 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:48.242730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-d62ec4c1-23e2-4ab9-a2f7-36f46d5a60c8 req-3464219a-97a4-459e-9b2c-301cadba5e42 service nova] Creating event network-vif-plugged:2c25634f-27f9-4868-a4bb-0f555233fe5e for instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 on hv-cinder-85799 Sep 16 03:50:48.250567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-d62ec4c1-23e2-4ab9-a2f7-36f46d5a60c8 req-3464219a-97a4-459e-9b2c-301cadba5e42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039922 Sep 16 03:50:48.253812 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 143/303] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:50:48.334890 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:48.336557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:48.343479 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:48.343954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:48.344383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:48.345065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:48.345514 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:48.345932 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:48.490733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:48.499686 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:48.501137 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:48.502349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-847c9b34-1a97-41d4-92c1-dfa556b54fa4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.171867 Sep 16 03:50:48.502892 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 161/304] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:48 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:48.518655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:48.519612 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:48.526577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:48.531906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:48.531906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:48.531906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:48.531906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:48.532349 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:48.704953 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:48.712863 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1c020e72-f8e7-4f65-ad53-b6cf3c24e01f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1510 microversion: 2.1 time: 0.205610 Sep 16 03:50:48.713424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 144/305] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:48 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:48.923898 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1661741458", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "networks": [{"uuid": "b5f7c9d9-2726-47bd-8b35-89fb0951bd43"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:48.933189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=88 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:48.940325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7b6c0b7b-eb16-42ba-bc21-448046b540fd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:48.947205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b6c0b7b-eb16-42ba-bc21-448046b540fd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:48.947989 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b6c0b7b-eb16-42ba-bc21-448046b540fd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:48.948390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b6c0b7b-eb16-42ba-bc21-448046b540fd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:48.980031 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] validate_networks() for [('b5f7c9d9-2726-47bd-8b35-89fb0951bd43', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:50:49.021699 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7b6c0b7b-eb16-42ba-bc21-448046b540fd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Going to try to stop instance {{(pid=127617) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 03:50:49.281213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7b6c0b7b-eb16-42ba-bc21-448046b540fd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/action" status: 202 len: 0 microversion: 2.1 time: 0.344500 Sep 16 03:50:49.284822 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 145/306] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:50:48 2022] POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 03:50:49.287431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:49.288194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:49.294207 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.294879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.295337 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.296021 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.296464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.296876 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.340050 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:50:49.340610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:50:49.341126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:50:49.341535 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:50:49.341945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:50:49.351300 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.351782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.352213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.352935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.353386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.353809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.370840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Getting quotas for project 0ea684aa585e4b4483261a014d861cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:50:49.375894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Getting quotas for user 5691b0a2de144779b3b9a276f4f9aa79 and project 0ea684aa585e4b4483261a014d861cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:50:49.387977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:50:49.390116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:50:49.441850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:49.450300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ea3e484b-97e2-4cce-be92-c206d1d23b10 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.166939 Sep 16 03:50:49.450872 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 146/307] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:49 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:49.455368 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:49.455918 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:49.461558 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.462106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.462503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.463218 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.463675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.472266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.504744 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-585d2584-62e5-4360-a4c1-a11d41d3c9b7 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584663 Sep 16 03:50:49.505686 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 162/308] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 03:50:49.517630 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5e81c7f6-88d4-4739-b24d-964a0d4c5072 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:49.518592 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5e81c7f6-88d4-4739-b24d-964a0d4c5072 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:49.588417 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5e81c7f6-88d4-4739-b24d-964a0d4c5072 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:49.596037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5e81c7f6-88d4-4739-b24d-964a0d4c5072 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1219 microversion: 2.1 time: 0.082663 Sep 16 03:50:49.596626 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 163/309] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:49 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:49.601802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:49.602456 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:49.610646 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.611443 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.612082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.612818 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.613274 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.613703 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.618431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:49.622820 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:49.628388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-67124a02-6dd9-4c70-b5ea-6a8218972535 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.176461 Sep 16 03:50:49.629218 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 147/310] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:49 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:49.740793 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:49.752128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:49.752128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.752128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.752128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.752479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:49.752479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:49.752479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:49.755733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:49.764591 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:49.766335 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:49.768193 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-92af05b5-559a-4bab-8ea6-60d338e13153 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.170115 Sep 16 03:50:49.768750 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 164/311] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:49 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:49.900691 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:49.909085 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-97d5f75d-a467-4d04-9758-b443d50544bb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1510 microversion: 2.1 time: 0.173156 Sep 16 03:50:49.909662 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 148/312] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:49 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:50.472248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:50.472865 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:50.485077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:50.485077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:50.485077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:50.485077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:50.485415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:50.485415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:50.617253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:50.619161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f312691e-d6dc-463b-b11e-16aa55b775d2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:50.620344 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f312691e-d6dc-463b-b11e-16aa55b775d2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:50.625870 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6a77303d-a235-40cf-acd2-f4f44002bd67 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.157506 Sep 16 03:50:50.626434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 165/313] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:50 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:50.657692 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:50.658584 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:50.664714 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:50.665194 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:50.665622 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:50.666294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:50.666744 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:50.667189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:50.673687 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f312691e-d6dc-463b-b11e-16aa55b775d2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:50.680852 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f312691e-d6dc-463b-b11e-16aa55b775d2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1219 microversion: 2.1 time: 0.065721 Sep 16 03:50:50.681416 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 149/314] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:50 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:50.793663 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:50.794822 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:50.798088 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:50.801444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:50.801932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:50.802462 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:50.803444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:50.803891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:50.804306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:50.807373 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f0902778-9ed5-424a-97b6-c8ab0c692eaf tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.153894 Sep 16 03:50:50.807944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 166/315] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:50 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:50.934544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:50.947186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:50.947186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:50.947404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:50.947404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:50.947404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c4c61480-6585-4b77-b515-c630c21cc7c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.155872 Sep 16 03:50:50.947678 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 150/316] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:50 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:50:50.955170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:50.955170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:50.955170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:50.955170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:50.955563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:50.956093 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:51.096170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:51.105338 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-639cc154-627f-4764-af0f-bcbc1019c4c6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1510 microversion: 2.1 time: 0.168600 Sep 16 03:50:51.105902 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 167/317] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:50 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:51.649175 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:51.649720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:51.656864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:51.657421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:51.657914 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:51.658627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:51.659104 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:51.659525 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:51.703437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:51.704126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:51.710568 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:51.711273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:51.711717 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:51.712414 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:51.712868 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:51.713293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:51.774067 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:51.782418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-940ad875-a0d7-443f-bf43-a863f292178f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1223 microversion: 2.1 time: 0.082898 Sep 16 03:50:51.783002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 168/318] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:51 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:51.796165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:51.804206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9bca9521-e1ba-40f4-8248-43fbed8619dd tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.159003 Sep 16 03:50:51.804764 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 151/319] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:51 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:51.829708 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:51.830320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:51.836293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:51.836777 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:51.837214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:51.837902 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:51.838356 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:51.838786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:51.967693 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:51.971465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:51.971708 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:51.976436 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f341af10-4aaa-46a9-b6f2-e304ff60b0c1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.150420 Sep 16 03:50:51.978954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 169/320] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:51 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:51.984035 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:51.984532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:51.985001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:51.985730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:51.986370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:51.986801 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:52.113471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:52.123054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:52.125982 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:52.126412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-96526f74-9205-494a-9ce3-b83574bfdd3b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.160208 Sep 16 03:50:52.127047 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 152/321] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:51 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:50:52.129075 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:52.129695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:52.135764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:52.136251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:52.136684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:52.138207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:52.138371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:52.139423 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:52.278539 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:52.286344 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c00186ca-cdbd-4223-939c-a1bc7447ddc6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1510 microversion: 2.1 time: 0.161158 Sep 16 03:50:52.287150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 170/322] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:52 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:52.804939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:52.805558 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:52.812659 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:52.813146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:52.813585 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:52.814283 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:52.814739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:52.815189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:52.825853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:52.826457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:52.833079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:52.833639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:52.834300 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:52.835057 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:52.835507 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:52.835967 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:52.878670 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:52.886142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7ce1e31c-154b-43b6-a862-a4a62d0f1fba tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1223 microversion: 2.1 time: 0.085348 Sep 16 03:50:52.886703 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 153/323] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:52 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:52.966388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:52.974335 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c1ab202-95c8-4abc-bdfd-4a06eac652c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.152326 Sep 16 03:50:52.974874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 171/324] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:52 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:53.000305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:53.001197 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:53.007359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:53.007850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:53.008284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:53.008968 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:53.009420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:53.009842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:53.150993 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:53.152433 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:53.153049 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:53.160558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:53.160873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-83bc9a7f-7b46-4477-9906-20b3257d8d94 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.165373 Sep 16 03:50:53.161199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:53.161458 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 154/325] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:52 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:53.161648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:53.162452 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:53.163083 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:53.163521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:53.309187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:53.310579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:53.311227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:53.317936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:53.331003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:53.331003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:53.331003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:53.331899 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:53.332006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:53.332006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:53.332006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:53.332261 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-83673581-8d8a-4191-ae54-48af87c6b512 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.172429 Sep 16 03:50:53.332261 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 172/326] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:53 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:50:53.456254 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:53.463977 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-00b4ae58-3640-42f9-acc5-b66b845ad341 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1516 microversion: 2.1 time: 0.158042 Sep 16 03:50:53.464535 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 155/327] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:53 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:53.910150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:53.911091 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:53.920890 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:53.921704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:53.922613 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:53.923587 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:53.924260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:53.924683 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:53.987460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:53.994881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d33ba6d5-ddc8-4def-b515-c98b7eace03a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1215 microversion: 2.1 time: 0.089878 Sep 16 03:50:53.995455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 173/328] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:53 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:53.998962 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:53.999549 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:54.006087 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:54.006634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:54.007102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:54.007803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:54.008354 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:54.009164 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:54.146094 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:54.151205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3cdd3f6f-95cd-476e-8101-c7c13e64fbf5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1260 microversion: 2.1 time: 0.156030 Sep 16 03:50:54.151205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 156/329] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:53 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:54.186738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:54.187378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:54.193213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:54.193686 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:54.194154 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:54.197275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:54.197275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:54.197275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:54.205055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:54.336731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:54.345433 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-79ece45c-0ac3-4e17-9e66-0275b9460154 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.164042 Sep 16 03:50:54.346005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 174/330] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:54 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:54.347132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:54.347810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:54.353938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:54.354580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:54.355048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:54.355765 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:54.356253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:54.356676 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:54.505538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:54.513888 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:54.515396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:54.516565 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-70c9f824-c802-4792-b193-9c5f589eb488 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.173635 Sep 16 03:50:54.517121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 157/331] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:54 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:50:55.019007 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:55.019618 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:55.026245 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.026722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.027528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.028218 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.028747 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.029987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.102386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:55.110196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-04b4e42b-92c0-4b7a-8012-0a3f70eeb150 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1271 microversion: 2.1 time: 0.095693 Sep 16 03:50:55.110751 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 175/332] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:55 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:55.173889 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:55.174541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:55.181447 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.182056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.182507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.183252 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.183712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.184141 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.277864 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dc8e77f0-7401-4f06-8d61-b2e2911650e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'create', calling method: .version_select at 0x7fba7c838e50>, body: {"keypair": {"name": "tempest-keypair-218737133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO5edfDtpJFyMSHEC/gmbOQMY84nFJT/B0MlaQYg73fuJZoUZaG+UpEex671fTVnqniM0csccRDs8Bqz1vSKxZFAQZt6+Z4p9KubKszCkj34G2nieHT3nuhehSoGS5ohQ=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:55.294199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-dc8e77f0-7401-4f06-8d61-b2e2911650e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Getting quotas for project ac97d1487c024a68b8ad933d882bb456. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:50:55.299873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-dc8e77f0-7401-4f06-8d61-b2e2911650e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Getting quotas for user a6b29b9086f64ea7a7990572567642f7 and project ac97d1487c024a68b8ad933d882bb456. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:50:55.327759 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:55.335392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9d7762b8-511c-477a-b6f7-214b48b6c077 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1444 microversion: 2.1 time: 0.166097 Sep 16 03:50:55.335950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 158/333] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:55 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:55.358517 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:55.359179 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:55.366915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.367429 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.367864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.368562 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.369015 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.369473 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.444368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dc8e77f0-7401-4f06-8d61-b2e2911650e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170494 Sep 16 03:50:55.444971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 176/334] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:50:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:50:55.449817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:55.450426 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:55.458279 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.458799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.459505 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.460212 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.460663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.461179 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.532247 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:55.540846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1d1436cd-f364-4a38-a9e6-ef0c593729ad tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1444 microversion: 2.1 time: 0.186351 Sep 16 03:50:55.541402 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 159/335] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:55 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1444 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:55.546084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:55.546669 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:55.554896 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.562143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.562143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.562143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:55.562143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:55.562717 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:55.645510 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:55.655666 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cb21abdf-2fab-4ba7-922e-049b5ed04bf2 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.209467 Sep 16 03:50:55.656546 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 177/336] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:55 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:55.739908 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:55.754292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:55.755796 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:55.756988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-31b6743f-bbd3-4f18-933a-21b9ffd5347d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.214675 Sep 16 03:50:55.757767 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 160/337] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:55 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:50:56.132337 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:56.132957 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:56.139428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:56.140159 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:56.140613 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:56.141303 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:56.141753 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:56.142427 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:56.222504 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:56.230320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-00bbc9ba-8e34-4d79-86bf-e80c0a664b99 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1271 microversion: 2.1 time: 0.101770 Sep 16 03:50:56.231113 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 178/338] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:56 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:56.680260 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:56.681002 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:56.697124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:56.698084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:56.698563 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:56.699281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:56.699733 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:56.700155 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:56.789023 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:56.789619 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:56.796578 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:56.797351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:56.797785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:56.798723 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:56.799234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:56.799720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:56.845861 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:56.854195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-66833823-5321-4cb8-9110-5861cf2c6dd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.178517 Sep 16 03:50:56.854751 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 161/339] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:56 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:56.932880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:56.941020 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:56.942493 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:56.943680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0ce4e5d1-ee82-4aa4-a4e6-bedab67951f7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.159697 Sep 16 03:50:56.944234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 179/340] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:56 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:50:57.254209 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:57.255033 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:57.261837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:57.262443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:57.263009 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:57.264336 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:57.264948 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:57.265954 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:57.345888 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:57.353649 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9fcf4422-493c-4669-ace9-9782257eb71f tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1271 microversion: 2.1 time: 0.103548 Sep 16 03:50:57.354204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 162/341] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:57 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:57.879818 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:57.884847 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:57.887068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:57.887556 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:57.887985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:57.888720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:57.889171 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:57.889597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:57.969730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:57.970343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:57.976919 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:57.977542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:57.977974 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:57.978719 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:57.979194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:57.979817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:58.101591 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:58.112275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fba11c08-86b1-4c69-8167-6815f4b74b11 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.236303 Sep 16 03:50:58.126930 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 180/342] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:57 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:58.219945 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:58.234608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:58.237007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:58.239433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-98e258bb-97f5-436e-a918-d439d12f4d54 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.273722 Sep 16 03:50:58.240307 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 163/343] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:57 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:50:58.380290 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:58.381390 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:58.393007 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:58.395612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:58.397411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:58.399355 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:58.400657 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:58.402614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:58.530059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:58.533177 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-b82bcec8-3abc-46a2-8cd4-310cf8772cf3 req-b81b8e61-0e4d-4f6b-803f-2e8342383b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d52b03d-e8ff-4942-a9d3-33b7341dad63", "tag": "2c25634f-27f9-4868-a4bb-0f555233fe5e"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:58.539344 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ec2b5a1f-7182-4e62-aecf-f05037047cd5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1271 microversion: 2.1 time: 0.165925 Sep 16 03:50:58.540307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 181/344] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:58 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:58.558025 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b82bcec8-3abc-46a2-8cd4-310cf8772cf3 req-b81b8e61-0e4d-4f6b-803f-2e8342383b76 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:58.560147 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b82bcec8-3abc-46a2-8cd4-310cf8772cf3 req-b81b8e61-0e4d-4f6b-803f-2e8342383b76 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:58.561021 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b82bcec8-3abc-46a2-8cd4-310cf8772cf3 req-b81b8e61-0e4d-4f6b-803f-2e8342383b76 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:58.572602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-b82bcec8-3abc-46a2-8cd4-310cf8772cf3 req-b81b8e61-0e4d-4f6b-803f-2e8342383b76 service nova] Creating event network-changed:2c25634f-27f9-4868-a4bb-0f555233fe5e for instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 on hv-cinder-85799 Sep 16 03:50:58.578298 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-b82bcec8-3abc-46a2-8cd4-310cf8772cf3 req-b81b8e61-0e4d-4f6b-803f-2e8342383b76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049793 Sep 16 03:50:58.580153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 164/345] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:50:58.731309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-387985621", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64754a20-d60c-49a4-9c39-1462c6265039"}], "security_groups": [{"name": "tempest-securitygroup--898070706"}], "key_name": "tempest-keypair-218737133", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:58.847573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] validate_networks() for [('64754a20-d60c-49a4-9c39-1462c6265039', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:50:59.139806 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:59.141262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:59.148371 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:59.149167 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:59.149653 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:59.150355 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:59.150807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:59.151261 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:59.365307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:59.462022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:59.478494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f1509642-e4e2-4faa-91a2-e2f6f394ab3f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.344440 Sep 16 03:50:59.479778 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 165/346] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:59 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:50:59.505192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:59.516294 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:59.530787 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:59.531580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:59.535187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:50:59.535597 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:59.535758 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:50:59.536068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:50:59.536476 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:50:59.537150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:50:59.537350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:59.538078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:59.539341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:59.552105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:59.559463 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:59.560848 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:59.561786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:59.563640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:59.563640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:59.563640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:59.595310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Getting quotas for project ac97d1487c024a68b8ad933d882bb456. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:50:59.600201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Getting quotas for user a6b29b9086f64ea7a7990572567642f7 and project ac97d1487c024a68b8ad933d882bb456. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:50:59.616323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:50:59.618854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:50:59.772452 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-12b0401a-9c24-42bb-bfc2-5ff49d9d1a54 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.045337 Sep 16 03:50:59.773398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 182/347] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:50:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:50:59.784974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:50:59.785841 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:50:59.796702 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:59.797348 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:59.797966 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:59.798875 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:50:59.799518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:50:59.801664 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:50:59.899433 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:50:59.911181 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b31f5e7f-c213-4c23-bb4d-4a5df33079cf tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1277 microversion: 2.1 time: 0.135406 Sep 16 03:50:59.912100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 183/348] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:50:59 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:50:59.922417 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-93f83e0f-f77e-4532-8c69-72e6844086f5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: .version_select at 0x7fba7cac31f0>, body: {"keypair": {"name": "tempest-keypair-705365470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLsAm6KK2w4K9Pf57vwNB7GvW770R7qYlTHH6xHdxdziZfeK7XUsSKTzXqtAv6iVFSq6fHyV8xTuiaDWsOe22PY96ZSub5ttJJBffOq42vifu2XHAVNMqMfewLPU6HEUg=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:50:59.955567 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-93f83e0f-f77e-4532-8c69-72e6844086f5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:50:59.961269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-93f83e0f-f77e-4532-8c69-72e6844086f5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for user ff7df9be8475405eba924b59a7bd6bb0 and project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:51:00.070563 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:00.079586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:00.081209 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:00.082607 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e5e2fed0-edf3-4151-a5e9-150b6cf10e77 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1743 microversion: 2.20 time: 0.587368 Sep 16 03:51:00.083209 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 166/349] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:50:59 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1743 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:00.101711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-93f83e0f-f77e-4532-8c69-72e6844086f5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188233 Sep 16 03:51:00.103098 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 184/350] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:50:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:00.108213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5adc7e29-db64-4bd8-8d8f-dfa30d8c4a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:00.108985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5adc7e29-db64-4bd8-8d8f-dfa30d8c4a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:00.169384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5adc7e29-db64-4bd8-8d8f-dfa30d8c4a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:00.176741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5adc7e29-db64-4bd8-8d8f-dfa30d8c4a3a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1244 microversion: 2.1 time: 0.073759 Sep 16 03:51:00.177592 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 167/351] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:00 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:00.514933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:00.515575 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:00.522427 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:00.522935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:00.523373 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:00.524080 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:00.524532 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:00.525819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:00.787223 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:00.796956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ef91d6e8-9deb-43c0-9f9b-895f9d842699 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.287585 Sep 16 03:51:00.811487 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 185/352] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:00 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:00.942550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:00.943190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:00.948965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:00.949443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:00.949870 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:00.950576 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:00.951060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:00.951481 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:01.099285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:01.109222 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-71a6dd39-f41d-471c-97d3-38e9ed6a2558 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.170441 Sep 16 03:51:01.109906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 168/353] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:00 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:01.125562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:01.125562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:01.125562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:01.125562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:01.125969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:01.125969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:01.125969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:01.125969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:01.126294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:01.204599 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:01.205077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:01.211803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:01.213044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:01.213820 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:01.214835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:01.215387 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:01.215811 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:01.319159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:01.328106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10e7e283-efe6-4878-8038-08225c78d6af tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1248 microversion: 2.1 time: 0.128222 Sep 16 03:51:01.329087 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 169/354] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:01 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1248 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:01.440654 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:01.453625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:01.455374 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:01.464960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-572a6a36-6da9-430e-a919-0e8847e6b1b8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1743 microversion: 2.20 time: 0.350581 Sep 16 03:51:01.464960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 186/355] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:01 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1743 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:01.749961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-b7843e94-3c63-4550-9093-a0114ebbaf40 req-4dcac7e4-7167-4a21-9563-f2fe646ca11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4ab7b5-8592-4a8b-bff6-d7316c09755e", "tag": "5531f7a3-f8a9-4c79-b05c-b2ef4472f8fc"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:01.759959 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b7843e94-3c63-4550-9093-a0114ebbaf40 req-4dcac7e4-7167-4a21-9563-f2fe646ca11b service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:01.760427 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b7843e94-3c63-4550-9093-a0114ebbaf40 req-4dcac7e4-7167-4a21-9563-f2fe646ca11b service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:01.760861 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b7843e94-3c63-4550-9093-a0114ebbaf40 req-4dcac7e4-7167-4a21-9563-f2fe646ca11b service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:01.772088 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-b7843e94-3c63-4550-9093-a0114ebbaf40 req-4dcac7e4-7167-4a21-9563-f2fe646ca11b service nova] Creating event network-changed:5531f7a3-f8a9-4c79-b05c-b2ef4472f8fc for instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e on hv-cinder-85799 Sep 16 03:51:01.777088 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-b7843e94-3c63-4550-9093-a0114ebbaf40 req-4dcac7e4-7167-4a21-9563-f2fe646ca11b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031900 Sep 16 03:51:01.777779 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 170/356] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:01.822589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:01.823236 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:01.830459 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:01.831105 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:01.831647 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:01.832444 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:01.832964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:01.833460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:02.134309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:02.138168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:02.139260 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:02.148151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-65f88b18-0d96-4713-a6bf-5dbae7ab43af tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.329249 Sep 16 03:51:02.149129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 187/357] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:01 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:02.157584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:02.157584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:02.157584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:02.157584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:02.167435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:02.167435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:02.361355 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:02.369863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:02.382856 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:02.391889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:02.400752 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:02.400752 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:02.405521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:02.406751 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f60eb9b3-27c5-4a99-b24a-23a4cad42963 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.272684 Sep 16 03:51:02.407172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:02.408345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 171/358] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:02 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:02.409375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:02.490319 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:02.490970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:02.501547 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:02.502523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:02.503359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:02.504347 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:02.505070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:02.506025 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:02.580882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:02.593853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7f762f2a-26f0-4ca3-afe1-b7c8c685cc48 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1296 microversion: 2.1 time: 0.246400 Sep 16 03:51:02.594769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 188/359] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:02 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1296 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:02.721911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-296a52c9-e5fd-4a63-a55b-528d66fbf634 req-35f23370-ed23-4f09-a946-1bb15ef6584d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230b59e9-09d0-4448-a6a6-a395823fcd8b", "name": "network-vif-plugged", "status": "completed", "tag": "a04cc8c1-86e6-4381-8e36-de59ce5d9321"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:02.738758 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-296a52c9-e5fd-4a63-a55b-528d66fbf634 req-35f23370-ed23-4f09-a946-1bb15ef6584d service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:02.740898 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-296a52c9-e5fd-4a63-a55b-528d66fbf634 req-35f23370-ed23-4f09-a946-1bb15ef6584d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:02.741543 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-296a52c9-e5fd-4a63-a55b-528d66fbf634 req-35f23370-ed23-4f09-a946-1bb15ef6584d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:02.743029 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:02.759987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:02.761698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:02.766121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-49418c24-b79a-4413-95f0-cb4ac0864ced tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.279779 Sep 16 03:51:02.767069 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 172/360] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:02 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:51:02.770388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-296a52c9-e5fd-4a63-a55b-528d66fbf634 req-35f23370-ed23-4f09-a946-1bb15ef6584d service nova] Creating event network-vif-plugged:a04cc8c1-86e6-4381-8e36-de59ce5d9321 for instance 230b59e9-09d0-4448-a6a6-a395823fcd8b on hv-cinder-85799 Sep 16 03:51:02.778113 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-296a52c9-e5fd-4a63-a55b-528d66fbf634 req-35f23370-ed23-4f09-a946-1bb15ef6584d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060586 Sep 16 03:51:02.780067 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 189/361] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:03.174451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:03.175368 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:03.185115 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:03.185827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:03.186265 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:03.205683 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:03.206373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:03.206833 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:03.432798 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:03.434201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:03.462073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:03.484874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:03.484874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:03.484874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:03.484874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:03.485400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:03.600270 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:03.610366 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-312d0c05-8647-4fce-ba45-945fc5128628 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.440314 Sep 16 03:51:03.611124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 173/362] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:03 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:03.628534 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:03.629751 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:03.636727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:03.637502 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:03.638772 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:03.640059 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:03.640686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:03.641287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:03.735093 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:03.744313 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e7db3b72-3608-4a44-b43e-e07360d58435 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1314 microversion: 2.1 time: 0.119541 Sep 16 03:51:03.744899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 174/363] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:03 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1314 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:03.800014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:03.803926 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:03.806450 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:03.817548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fb22a5be-93d0-4f30-9f4a-e5b5ce931214 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.389067 Sep 16 03:51:03.818135 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 190/364] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:03 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:03.819640 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:03.820320 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:03.820920 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:03.821790 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:03.822394 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:03.823007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:04.000616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:04.017744 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:04.019267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:04.020881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-674aea4c-bee8-4663-8cb0-43a9c7eb54de tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.230816 Sep 16 03:51:04.021882 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 175/365] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:03 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:04.404513 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-803264551", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ff8c520-12d3-47e5-b499-6dbd6e9a131a"}], "security_groups": [{"name": "tempest-securitygroup--2102417147"}], "key_name": "tempest-keypair-705365470", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:04.530828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] validate_networks() for [('4ff8c520-12d3-47e5-b499-6dbd6e9a131a', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:51:04.637665 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:04.640985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:04.652880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:04.656946 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:04.658253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:04.660035 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:04.660809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:04.663394 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:04.916853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:04.926169 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9c7901ca-4c76-4da9-aefe-c20120083cbc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.292255 Sep 16 03:51:04.957362 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 176/366] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:04 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:04.963610 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:04.964603 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:04.972211 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:04.973039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:04.973974 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:04.974938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:04.975564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:04.976131 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:05.070884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:05.095686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bfe9a6ec-1e6c-4812-b719-cbab958799f3 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1302 microversion: 2.1 time: 0.136243 Sep 16 03:51:05.096528 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 177/367] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:04 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1302 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:05.133669 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:05.134297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:05.156843 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:05.159363 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:05.163111 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:05.163985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:05.164702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:05.165563 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:05.319663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:51:05.320295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:51:05.320766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:51:05.321167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:51:05.321745 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:51:05.336287 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:05.337341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:05.337961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:05.338954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:05.339637 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:05.340217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:05.360093 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:51:05.366280 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for user ff7df9be8475405eba924b59a7bd6bb0 and project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:51:05.379424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:51:05.382034 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:51:05.437889 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:05.450166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f4ed13eb-dec2-4576-9c71-7c4fa7750ef2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.326388 Sep 16 03:51:05.466075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 178/368] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:05 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:05.466075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:05.466075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:05.470367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:05.470570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:05.471755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:05.472702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:05.473304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:05.473745 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:05.585682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aef7c724-6267-4552-b21e-a0aa78207cbf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.186736 Sep 16 03:51:05.587724 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 191/369] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:51:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:51:05.601975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-950dd7af-b363-4ae7-8740-36fbd913f249 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:05.618444 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-950dd7af-b363-4ae7-8740-36fbd913f249 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:05.722894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-950dd7af-b363-4ae7-8740-36fbd913f249 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:05.742122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-950dd7af-b363-4ae7-8740-36fbd913f249 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1240 microversion: 2.1 time: 0.144520 Sep 16 03:51:05.743752 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 192/370] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:05 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:05.929160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:05.950124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:05.956264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:05.958417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f0d87d5a-cb36-4147-a1d8-a9f02a3f64aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.505248 Sep 16 03:51:05.981031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 179/371] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:05 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:05.982722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:05.982722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:05.985827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:05.986398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:05.987270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:05.987866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:05.988386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:05.988883 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:06.127103 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:06.127721 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:06.142124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:06.146103 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:06.155964 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:06.156791 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:06.157281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:06.157729 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:06.162248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:06.178997 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2983d96b-0a90-4c95-b0ab-fff7b729dd93 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.204311 Sep 16 03:51:06.186471 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 193/372] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:05 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:06.474232 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:06.474851 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:06.475831 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:06.484683 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9c3f08fd-335f-4198-9db5-1a0fd13d6f33 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1369 microversion: 2.1 time: 0.362258 Sep 16 03:51:06.485037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:06.485487 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:06.485947 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:06.486683 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:06.487214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:06.487654 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:06.490561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 180/373] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:06 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1369 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:06.714428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:06.732946 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5d3c26cf-c04a-4c6c-8f4a-d7a9bf46b96d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.262450 Sep 16 03:51:06.736770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 194/374] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:06 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:06.767653 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a03bc76d-6448-48f9-b0ff-7ed403a7f5d3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:06.768582 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a03bc76d-6448-48f9-b0ff-7ed403a7f5d3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:06.910572 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a03bc76d-6448-48f9-b0ff-7ed403a7f5d3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:06.917521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a03bc76d-6448-48f9-b0ff-7ed403a7f5d3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1240 microversion: 2.1 time: 0.155320 Sep 16 03:51:06.918323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 181/375] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:06 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1240 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:06.989076 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:06.989800 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:06.996089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:06.996622 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:06.997055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:06.998339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:06.998936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:06.999367 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:07.132655 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:07.136195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:07.141407 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:07.142880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:07.144061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-64105fc5-f566-4d10-b014-bf6ac717bf8f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.159040 Sep 16 03:51:07.144648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 195/376] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:06 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:07.205046 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:07.205656 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:07.212442 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:07.213135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:07.213713 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:07.214603 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:07.215083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:07.215506 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:07.404634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:07.413488 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c459167f-25a5-4787-9b72-794702b5e104 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.212349 Sep 16 03:51:07.414064 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 182/377] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:07 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:07.517407 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:07.518020 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:07.524874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:07.525699 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:07.526363 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:07.527326 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:07.528017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:07.529205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:07.723851 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:07.737412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c9fcf009-697a-42ae-9740-690c5a05c9c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1369 microversion: 2.1 time: 0.221402 Sep 16 03:51:07.738026 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 196/378] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:07 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:07.759334 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:07.763675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:07.771043 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:07.771557 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:07.771979 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:07.777068 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:07.777543 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:07.778121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:07.942048 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:07.951958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:07.976973 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:07.977428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:07.978160 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:07.981968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:07.983552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:07.984432 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.073842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:08.095739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-78d6e021-769e-4d8a-8896-c74e0d929ff2 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.338347 Sep 16 03:51:08.097746 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 183/379] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:07 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:08.112026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-f53d75bc-b4b6-4f15-9619-38d2faaea45d req-733ccaa9-c1cb-46e4-a47a-d4028180fc4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7bab22-1639-467d-ba7a-94c97e1b9231", "tag": "552dfee7-ff27-4901-a9cb-8d274e8becd6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:08.135400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f53d75bc-b4b6-4f15-9619-38d2faaea45d req-733ccaa9-c1cb-46e4-a47a-d4028180fc4b service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:08.136698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f53d75bc-b4b6-4f15-9619-38d2faaea45d req-733ccaa9-c1cb-46e4-a47a-d4028180fc4b service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:08.137305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f53d75bc-b4b6-4f15-9619-38d2faaea45d req-733ccaa9-c1cb-46e4-a47a-d4028180fc4b service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.149103 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:08.155633 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-f53d75bc-b4b6-4f15-9619-38d2faaea45d req-733ccaa9-c1cb-46e4-a47a-d4028180fc4b service nova] Creating event network-changed:552dfee7-ff27-4901-a9cb-8d274e8becd6 for instance aa7bab22-1639-467d-ba7a-94c97e1b9231 on hv-cinder-85799 Sep 16 03:51:08.162189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9ca0e702-eded-41a8-bf4c-a5234aae5251 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1236 microversion: 2.1 time: 0.223799 Sep 16 03:51:08.163429 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-f53d75bc-b4b6-4f15-9619-38d2faaea45d req-733ccaa9-c1cb-46e4-a47a-d4028180fc4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064243 Sep 16 03:51:08.164512 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 184/380] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:08.175418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 197/381] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:07 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1236 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:08.189290 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:08.190237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:08.201739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:08.202938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:08.203567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.204750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:08.205363 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:08.206747 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.440878 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:08.441557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:08.474607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:08.475135 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:08.475559 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.476580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:08.477249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:08.477847 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.652724 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:08.663205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7aa49c70-ce00-4a7b-8725-fc6e2eb9ed2b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.229114 Sep 16 03:51:08.663379 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:08.665331 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 198/382] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:08 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:08.687741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:08.693450 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:08.695440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bcd03ac3-1437-4b09-bd37-5fe71924883b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.529150 Sep 16 03:51:08.701244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 185/383] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:08 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:08.757557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-de6d5a50-e526-4a24-b7e9-3a4c9415a151 req-b6ed6c1e-3358-4907-a557-d9dcee2c1834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4ab7b5-8592-4a8b-bff6-d7316c09755e", "name": "network-vif-plugged", "status": "completed", "tag": "5531f7a3-f8a9-4c79-b05c-b2ef4472f8fc"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:08.770383 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:08.771110 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:08.777476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:08.792976 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:08.793681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-de6d5a50-e526-4a24-b7e9-3a4c9415a151 req-b6ed6c1e-3358-4907-a557-d9dcee2c1834 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:08.795142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:08.795584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.796087 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-de6d5a50-e526-4a24-b7e9-3a4c9415a151 req-b6ed6c1e-3358-4907-a557-d9dcee2c1834 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:08.796905 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-de6d5a50-e526-4a24-b7e9-3a4c9415a151 req-b6ed6c1e-3358-4907-a557-d9dcee2c1834 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.797362 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:08.797829 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:08.800407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:08.836946 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:08.844313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-de6d5a50-e526-4a24-b7e9-3a4c9415a151 req-b6ed6c1e-3358-4907-a557-d9dcee2c1834 service nova] Creating event network-vif-plugged:5531f7a3-f8a9-4c79-b05c-b2ef4472f8fc for instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e on hv-cinder-85799 Sep 16 03:51:08.848194 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-de6d5a50-e526-4a24-b7e9-3a4c9415a151 req-b6ed6c1e-3358-4907-a557-d9dcee2c1834 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094513 Sep 16 03:51:08.849113 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 199/384] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:09.034042 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:09.043532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c4747897-5e77-4b69-9b3e-f6519f484efe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1369 microversion: 2.1 time: 0.282133 Sep 16 03:51:09.044847 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 186/385] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:08 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1369 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:09.122720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:09.125026 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:09.133371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:09.136722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:09.136722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:09.136722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:09.136722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:09.137738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:09.197312 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:09.198365 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:09.209389 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:09.210837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:09.211550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:09.212566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:09.213192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:09.213742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:09.300291 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:09.326144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8d6c204a-378e-4b96-842e-70913b8f30f7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1292 microversion: 2.1 time: 0.126396 Sep 16 03:51:09.326144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 187/386] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:09 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1292 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:09.365468 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:09.373412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cb34e324-9160-4581-94de-6c6dca95d7a8 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.255495 Sep 16 03:51:09.373975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 200/387] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:09 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:09.689066 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:09.689921 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:09.697293 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:09.697785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:09.698224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:09.699145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:09.699615 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:09.700039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:09.734534 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:09.735185 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:09.741879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:09.742367 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:09.742802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:09.743527 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:09.743977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:09.744404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:09.911525 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:09.914871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:09.925871 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e027d19a-497d-4d59-98c8-214da85b415f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.241807 Sep 16 03:51:09.926425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:09.928277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:09.930101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d9a5e5f2-f5ff-467f-9fbe-108905f77065 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.200230 Sep 16 03:51:09.947265 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 188/388] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:09 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:09.948067 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 201/389] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:09 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:51:10.073279 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:10.073279 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:10.085634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.086435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.087163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.088252 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.088788 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.089281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.243274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:10.253314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10305e8e-e7e3-426a-aa02-f35a691d9848 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1369 microversion: 2.1 time: 0.187050 Sep 16 03:51:10.258959 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 189/390] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:10 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1369 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:10.348819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:10.349725 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:10.359735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.361283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.361732 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.362443 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.362942 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.364016 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.407382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:10.408252 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:10.422005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.423932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.425768 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.427348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.427811 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.428245 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.503404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:10.514953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b2395f9b-22cd-4847-a8c6-572a1622115b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1300 microversion: 2.1 time: 0.171424 Sep 16 03:51:10.516808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 202/391] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:10 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1300 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:10.879874 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:10.892268 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-64d94238-fa3e-41a2-89de-0a07f25f9258 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.497997 Sep 16 03:51:10.893107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 190/392] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:10 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:10.952951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:10.953672 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:10.961671 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:10.962303 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:10.970518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.971666 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.971666 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.975731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.977378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.977986 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.978161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.979383 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.980013 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:10.980639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:10.983460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:10.984104 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:11.235924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:11.249957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:11.255197 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:11.255550 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:11.259578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c774ea52-dd01-4e4c-8ccc-cf9c315fd571 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.302089 Sep 16 03:51:11.282337 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4197b3e0-9500-4ea3-9442-f3b2ba581b21 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.320066 Sep 16 03:51:11.282337 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 203/393] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:10 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:11.282582 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 191/394] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:10 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:51:11.282675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:11.282675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:11.289789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:11.290386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:11.290875 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:11.292249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:11.292772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:11.293990 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:11.539781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:11.540451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:11.551909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:11.552782 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:11.554517 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:11.555961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:11.558513 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:11.559820 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:11.569167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:11.581210 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a22293a3-56a0-436f-b8f7-8665a6b6a547 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1369 microversion: 2.1 time: 0.307483 Sep 16 03:51:11.583336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 204/395] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:11 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1369 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:11.726937 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:11.736906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fb9ae6d9-517f-4e11-9b48-f7f84f0a640c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1298 microversion: 2.1 time: 0.201876 Sep 16 03:51:11.742114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 192/396] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:11 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1298 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:11.921638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:11.922727 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:11.933489 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:11.934341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:11.935213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:11.936236 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:11.937062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:11.937676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.119909 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:12.134157 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ff331ffe-8e08-4103-b2de-f757c0f66efc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1319 microversion: 2.1 time: 0.218679 Sep 16 03:51:12.134736 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 205/397] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:11 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:12.289479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:12.290096 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:12.295597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:12.296215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:12.297112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.308965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.308965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.308965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.308965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.309299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.309378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.309378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.309378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.309378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.309687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.309687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.449338 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:12.459841 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:12.471864 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-447b6cec-bf76-47e6-af4d-97a475f7f1b1 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1722 microversion: 2.1 time: 0.180600 Sep 16 03:51:12.482594 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:12.482594 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:12.483014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 206/398] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:12 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:12.483283 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a5753712-3978-46fc-bc29-b0f393d7faed tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.193488 Sep 16 03:51:12.493841 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 193/399] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:12 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:12.614576 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:12.614576 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:12.646974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.646974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.647288 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.649416 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.650089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.650529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.761754 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:12.762296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:12.770294 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.785656 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.786604 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.787597 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.791647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.793216 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:12.947109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:12.960809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-668793ed-857d-46b7-8d8c-74065c86450f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1369 microversion: 2.1 time: 0.355114 Sep 16 03:51:12.961545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 207/400] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:12 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1369 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:12.973929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-0a32fe13-e163-4af7-9adc-a0cac168c3fd req-f2fd7baf-1a04-4ade-ac66-d338be960221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7bab22-1639-467d-ba7a-94c97e1b9231", "name": "network-vif-plugged", "status": "completed", "tag": "552dfee7-ff27-4901-a9cb-8d274e8becd6"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:12.996072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0a32fe13-e163-4af7-9adc-a0cac168c3fd req-f2fd7baf-1a04-4ade-ac66-d338be960221 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:12.996549 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0a32fe13-e163-4af7-9adc-a0cac168c3fd req-f2fd7baf-1a04-4ade-ac66-d338be960221 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:12.996981 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0a32fe13-e163-4af7-9adc-a0cac168c3fd req-f2fd7baf-1a04-4ade-ac66-d338be960221 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:13.029711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-0a32fe13-e163-4af7-9adc-a0cac168c3fd req-f2fd7baf-1a04-4ade-ac66-d338be960221 service nova] Creating event network-vif-plugged:552dfee7-ff27-4901-a9cb-8d274e8becd6 for instance aa7bab22-1639-467d-ba7a-94c97e1b9231 on hv-cinder-85799 Sep 16 03:51:13.036600 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-0a32fe13-e163-4af7-9adc-a0cac168c3fd req-f2fd7baf-1a04-4ade-ac66-d338be960221 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073366 Sep 16 03:51:13.047413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 208/401] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:13.159356 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:13.160076 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:13.171881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:13.172287 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:13.172721 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:13.173424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:13.173875 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:13.174308 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:13.358750 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:13.367275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0362e7f7-d388-497d-9c65-de3547f4e301 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1508 microversion: 2.1 time: 0.213281 Sep 16 03:51:13.368235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 209/402] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:13 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:13.453424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:13.463292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-35aa1356-53e4-4f0a-831f-f455fd05954d tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.705378 Sep 16 03:51:13.480393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 194/403] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:12 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:13.504064 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:13.504684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:13.519779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:13.520872 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:13.520872 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:13.521414 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:13.521767 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:13.521900 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:13.522281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:13.525220 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:13.554776 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:13.556826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:13.557299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:13.565671 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:13.566269 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:13.567844 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:13.865656 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:13.868460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-55aabbc2-3f28-47e9-a702-f7666593c1c7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1699 microversion: 2.1 time: 0.368563 Sep 16 03:51:13.869329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 210/404] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:13 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1699 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:13.897733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-43e0864c-ea57-495f-a902-f038016132d5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:13.911216 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43e0864c-ea57-495f-a902-f038016132d5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:13.911684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43e0864c-ea57-495f-a902-f038016132d5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:13.912138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43e0864c-ea57-495f-a902-f038016132d5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:13.959793 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:13.972256 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:13.975173 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:13.976724 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-48e5b91d-539f-430e-9765-74b655c1cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.470364 Sep 16 03:51:13.977786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 195/405] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:13 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:13.978778 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-43e0864c-ea57-495f-a902-f038016132d5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Going to try to start instance {{(pid=127618) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 03:51:14.007251 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:14.009505 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:14.017788 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:14.018297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:14.018737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:14.019561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:14.019982 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:14.020408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:14.286664 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-43e0864c-ea57-495f-a902-f038016132d5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/action" status: 202 len: 0 microversion: 2.1 time: 0.393044 Sep 16 03:51:14.287517 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 211/406] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:51:13 2022] POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 03:51:14.306066 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:14.308437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:14.326451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:14.348486 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2072636a-39d3-4a34-aeee-f92455ccecac tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1369 microversion: 2.1 time: 0.362362 Sep 16 03:51:14.349855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 196/407] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:13 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1369 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:14.360118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:14.362610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:14.363109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:14.364076 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:14.368175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:14.369059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:14.491271 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:14.491893 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:14.511035 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:14.515490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:14.517218 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:14.517997 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:14.520471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:14.521163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:14.669002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:14.677393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:14.681968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-73d0f6cc-aadf-4faf-9676-37a7ef1befbe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1708 microversion: 2.1 time: 0.389302 Sep 16 03:51:14.682992 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 212/408] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:14 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1708 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:14.688646 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b06f4029-1c5b-4eab-b984-0bb9a0db4e1b req-779779f0-833e-43e6-86b8-39b6733e8e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb8293f-e305-41ce-82f8-3a111fb43322", "tag": "ffb46fb6-10f2-412d-863b-b8a8006435ee"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:14.741618 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b06f4029-1c5b-4eab-b984-0bb9a0db4e1b req-779779f0-833e-43e6-86b8-39b6733e8e22 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:14.743494 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b06f4029-1c5b-4eab-b984-0bb9a0db4e1b req-779779f0-833e-43e6-86b8-39b6733e8e22 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:14.745582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b06f4029-1c5b-4eab-b984-0bb9a0db4e1b req-779779f0-833e-43e6-86b8-39b6733e8e22 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:14.783721 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b06f4029-1c5b-4eab-b984-0bb9a0db4e1b req-779779f0-833e-43e6-86b8-39b6733e8e22 service nova] Creating event network-changed:ffb46fb6-10f2-412d-863b-b8a8006435ee for instance 4cb8293f-e305-41ce-82f8-3a111fb43322 on hv-cinder-85799 Sep 16 03:51:14.796502 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b06f4029-1c5b-4eab-b984-0bb9a0db4e1b req-779779f0-833e-43e6-86b8-39b6733e8e22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111073 Sep 16 03:51:14.799312 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 213/409] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:14.889950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:14.900005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4ec8097f-439a-4ead-a1e5-23fd8419d52b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.412919 Sep 16 03:51:14.914333 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 197/410] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:14 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:15.011205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:15.012486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:15.023805 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:15.024874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:15.025568 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:15.026524 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:15.027248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:15.027939 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:15.281678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:15.294601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:15.297621 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:15.299352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6cbe44a1-bb78-4005-a19e-21414c3100f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.294115 Sep 16 03:51:15.300289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 214/411] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:15 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:15.375255 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:15.376319 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:15.383579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:15.388569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:15.388569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:15.388569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:15.388569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:15.389036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:15.603065 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:15.616361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8f5461af-edc5-4b46-9fdf-f23069b363c1 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1369 microversion: 2.1 time: 0.246507 Sep 16 03:51:15.619587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 198/412] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:15 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:15.717367 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:15.717984 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:15.735389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:15.741760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:15.744583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:15.751582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:15.755811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:15.760127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:15.764880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:15.765781 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=30 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:15.925036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:15.925823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:15.948263 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:15.955908 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:15.956498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:15.958314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:15.959578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:15.961115 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:16.061900 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:16.073199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8b58bdb8-8ab0-4d8e-9084-1727400b5734 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1708 microversion: 2.1 time: 0.360095 Sep 16 03:51:16.087542 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 215/413] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:15 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1708 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:16.287315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:16.305835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-33124f3b-cf9e-436b-9b80-1fe5c2cb7e8b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.385278 Sep 16 03:51:16.320705 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 199/414] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:15 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:16.331859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:16.332628 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:16.345558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:16.350786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:16.350786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:16.350786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:16.350786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:16.351492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:16.612901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:16.631596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:16.633334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:16.634527 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8efb39ff-956a-4fd0-bad5-74c4be738529 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.312391 Sep 16 03:51:16.635420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 216/415] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:16 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:16.644361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:16.645495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:16.660603 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:16.661950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:16.663265 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:16.664250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:16.665797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:16.667040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:16.881478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:16.890994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7f4e3298-4b43-42b8-93ff-6ecdf1e4f2fb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1562 microversion: 2.1 time: 0.251915 Sep 16 03:51:16.892152 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 200/416] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:16 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:16.916101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:16.924420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:16.925830 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:16.926451 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:16.927049 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:16.928073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:16.929309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:16.929930 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:17.051928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bbebb95a-311b-41e0-b94d-e43c4e5e21ff tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139822 Sep 16 03:51:17.064119 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 217/417] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 16 03:51:16 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:17.145477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:17.145477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:17.145477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:17.145477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:17.145477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:17.146234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:17.146234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:17.146234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:17.146234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:17.333853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:17.334473 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:17.340409 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:17.341408 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:17.342000 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:17.342706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:17.343195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:17.343622 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:17.477279 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:17.488915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e21f635a-aef0-4984-8ff5-1d58e6646762 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1708 microversion: 2.1 time: 0.392410 Sep 16 03:51:17.490195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 201/418] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:17 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1708 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:17.496052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:17.505387 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6274baee-19a6-4b8e-a755-aa565eb63970 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.175280 Sep 16 03:51:17.508394 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 218/419] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:17 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:17.660837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:17.661627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:17.669571 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:17.671174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:17.671174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:17.671612 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:17.672058 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:17.672476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:17.864541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:17.875176 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:17.875176 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:17.875709 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:17.877832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6d167921-5360-47c4-865f-aacd518fa070 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.220885 Sep 16 03:51:17.888216 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 202/420] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:17 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:18.517525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:18.518133 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:18.530703 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:18.532295 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:18.567892 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:18.569288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:18.570272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:18.572391 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:18.576388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:18.577265 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:18.578627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:18.579315 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:18.580532 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:18.584371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:18.586039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:18.592683 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:18.816922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:18.828252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-90cc3061-08cd-45fd-8774-f8fbfb67f5c3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1708 microversion: 2.1 time: 0.318029 Sep 16 03:51:18.844518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:18.850316 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 219/421] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:18 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1708 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:18.855472 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-81431148-c3be-4049-a05d-c6f8cbb54574 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.326529 Sep 16 03:51:18.859196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-2bb46e3c-5c89-4769-9b0f-c8eea03e72e0 req-64f85751-94ff-435a-8948-38edf9d312df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7bab22-1639-467d-ba7a-94c97e1b9231", "tag": "552dfee7-ff27-4901-a9cb-8d274e8becd6"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:18.895070 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2bb46e3c-5c89-4769-9b0f-c8eea03e72e0 req-64f85751-94ff-435a-8948-38edf9d312df service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:18.895840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2bb46e3c-5c89-4769-9b0f-c8eea03e72e0 req-64f85751-94ff-435a-8948-38edf9d312df service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:18.896257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 203/422] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:18 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:18.896658 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2bb46e3c-5c89-4769-9b0f-c8eea03e72e0 req-64f85751-94ff-435a-8948-38edf9d312df service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:18.904851 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:18.905697 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:18.912250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:18.912997 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:18.913582 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:18.914553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:18.914676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-2bb46e3c-5c89-4769-9b0f-c8eea03e72e0 req-64f85751-94ff-435a-8948-38edf9d312df service nova] Creating event network-changed:552dfee7-ff27-4901-a9cb-8d274e8becd6 for instance aa7bab22-1639-467d-ba7a-94c97e1b9231 on hv-cinder-85799 Sep 16 03:51:18.915314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:18.915886 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:18.924929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-2bb46e3c-5c89-4769-9b0f-c8eea03e72e0 req-64f85751-94ff-435a-8948-38edf9d312df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071709 Sep 16 03:51:18.934222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 220/423] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:19.430902 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:19.444963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:19.449048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:19.453204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-666a85ab-f654-4cd4-b43b-3dd55f699f8b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1738 microversion: 2.20 time: 0.553874 Sep 16 03:51:19.458657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 204/424] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:18 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1738 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:51:19.859489 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:19.861718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:19.872238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:19.872948 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:19.873879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:19.874943 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:19.875508 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:19.876127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:19.905320 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:19.905320 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:19.913943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:19.914529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:19.915005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:19.915818 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:19.916289 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:19.916721 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:20.068000 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:20.080177 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5ebba830-20d5-4671-925a-9f865c23cadd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1712 microversion: 2.1 time: 0.226746 Sep 16 03:51:20.094937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 221/425] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:19 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1712 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:20.197100 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:20.210107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eaed3207-8fa2-4dab-b963-9fc9232f58e2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.313427 Sep 16 03:51:20.223264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 205/426] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:19 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:20.479440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:20.480307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:20.487824 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:20.488304 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:20.488731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:20.489430 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:20.489872 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:20.490286 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:20.637713 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:20.646064 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:20.650558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:20.650558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-88e84d02-89c3-4971-b44b-759d9081f74f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1720 microversion: 2.20 time: 0.173304 Sep 16 03:51:20.650558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 222/427] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:20 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:21.235249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:21.236483 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:21.249080 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:21.259057 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:21.259686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:21.260589 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:21.261203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:21.261808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:21.437366 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:21.447156 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-300248f8-bdd4-4f25-929b-2e408808cecc tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.217351 Sep 16 03:51:21.447798 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 206/428] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:21 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:21.576296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-c5b589be-d146-452b-a0cd-eeb743c392fd req-17d85d47-9d56-4976-8348-4d9bcaa0cc42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb8293f-e305-41ce-82f8-3a111fb43322", "name": "network-vif-plugged", "status": "completed", "tag": "ffb46fb6-10f2-412d-863b-b8a8006435ee"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:21.587389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c5b589be-d146-452b-a0cd-eeb743c392fd req-17d85d47-9d56-4976-8348-4d9bcaa0cc42 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:21.591560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c5b589be-d146-452b-a0cd-eeb743c392fd req-17d85d47-9d56-4976-8348-4d9bcaa0cc42 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:21.591560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c5b589be-d146-452b-a0cd-eeb743c392fd req-17d85d47-9d56-4976-8348-4d9bcaa0cc42 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:21.605541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-c5b589be-d146-452b-a0cd-eeb743c392fd req-17d85d47-9d56-4976-8348-4d9bcaa0cc42 service nova] Creating event network-vif-plugged:ffb46fb6-10f2-412d-863b-b8a8006435ee for instance 4cb8293f-e305-41ce-82f8-3a111fb43322 on hv-cinder-85799 Sep 16 03:51:21.611269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-c5b589be-d146-452b-a0cd-eeb743c392fd req-17d85d47-9d56-4976-8348-4d9bcaa0cc42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038636 Sep 16 03:51:21.611883 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 223/429] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:21.674326 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:21.674844 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:21.681031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:21.681511 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:21.681940 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:21.682627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:21.683096 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:21.683732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:21.829705 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:21.838549 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:21.840292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:21.841917 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d2f294b9-d036-4fd2-a1c3-f68278d34ac7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1720 microversion: 2.20 time: 0.171316 Sep 16 03:51:21.842549 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 207/430] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:21 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:22.470378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:22.471169 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:22.477363 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:22.477853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:22.478287 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:22.482179 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:22.483840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:22.483840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:22.629518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:22.637852 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0dac367e-b46d-4130-b9e5-4b78150e3148 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.171566 Sep 16 03:51:22.638433 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 224/431] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:22 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:22.872639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:22.873394 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:22.879840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:22.880328 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:22.880765 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:22.881507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:22.881962 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:22.882387 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:23.021554 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:23.029621 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:23.031037 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:23.032214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-160f4447-62da-4e4a-8726-13923ddc7746 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1720 microversion: 2.20 time: 0.163746 Sep 16 03:51:23.032770 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 208/432] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:22 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:23.626835 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-63a6992c-6a34-4a66-b4e1-e4c1273f7c07 req-8ac6dbb5-e5f7-41cb-a670-8f5a96f55c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230b59e9-09d0-4448-a6a6-a395823fcd8b", "name": "network-vif-unplugged", "status": "completed", "tag": "a04cc8c1-86e6-4381-8e36-de59ce5d9321"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:23.636457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-63a6992c-6a34-4a66-b4e1-e4c1273f7c07 req-8ac6dbb5-e5f7-41cb-a670-8f5a96f55c87 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:23.638369 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-63a6992c-6a34-4a66-b4e1-e4c1273f7c07 req-8ac6dbb5-e5f7-41cb-a670-8f5a96f55c87 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:23.639051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-63a6992c-6a34-4a66-b4e1-e4c1273f7c07 req-8ac6dbb5-e5f7-41cb-a670-8f5a96f55c87 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:23.651819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-63a6992c-6a34-4a66-b4e1-e4c1273f7c07 req-8ac6dbb5-e5f7-41cb-a670-8f5a96f55c87 service nova] Creating event network-vif-unplugged:a04cc8c1-86e6-4381-8e36-de59ce5d9321 for instance 230b59e9-09d0-4448-a6a6-a395823fcd8b on hv-cinder-85799 Sep 16 03:51:23.660313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-63a6992c-6a34-4a66-b4e1-e4c1273f7c07 req-8ac6dbb5-e5f7-41cb-a670-8f5a96f55c87 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037887 Sep 16 03:51:23.661316 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 225/433] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:23.662725 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:23.663377 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:23.672526 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:23.674853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:23.674853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:23.674853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:23.674853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:23.675255 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:23.851452 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:23.859602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-41de75e6-611b-4f7f-8637-1012b17c8411 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.202420 Sep 16 03:51:23.860171 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 209/434] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:23 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:24.059042 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:24.060211 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:24.066976 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:24.067401 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:24.067840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:24.068535 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:24.068991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:24.069412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:24.276431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:24.286124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:24.288076 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:24.289532 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0f292427-b7c2-4f67-8507-869678ab883f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1720 microversion: 2.20 time: 0.234908 Sep 16 03:51:24.290196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 226/435] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:24 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:24.883542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:24.884106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:24.890795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:24.895306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:24.895306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:24.895306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:24.895306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:24.895897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:25.025582 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:25.033852 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ebca110b-7823-48e0-af62-5714707bae10 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.154150 Sep 16 03:51:25.034382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 210/436] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:24 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:25.317605 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:25.318568 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:25.321276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:25.326337 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:25.326892 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:25.327518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:25.329190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:25.333167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:25.333167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:25.480561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:25.489682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:25.491617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:25.492857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7b26677c-526a-4ada-9064-b1c23091ae9c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1723 microversion: 2.20 time: 0.180105 Sep 16 03:51:25.493494 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 227/437] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:25 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:25.517957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7691292-e766-4b1c-b523-d883e7410a19"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:25.520478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:25.526481 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:25.526987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:25.527424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:25.528120 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:25.529110 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:25.529500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:26.057391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:26.058061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:26.065683 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:26.066180 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:26.066648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:26.067395 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:26.067842 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:26.068266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:26.208392 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:26.216079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e4650c57-f779-4311-a5e9-9ce0eeda85a0 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1366 microversion: 2.1 time: 0.162785 Sep 16 03:51:26.216962 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 228/438] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:26 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:51:26.780884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-121c0551-4b78-4e4a-a486-9486d6f02365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.267376 Sep 16 03:51:26.782201 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 211/439] 10.222.0.49 () {62 vars in 1364 bytes} [Fri Sep 16 03:51:25 2022] POST /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments => generated 188 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:51:26.913906 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:26.914530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:26.921949 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:26.922425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:26.922858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:26.923565 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:26.924013 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:26.924446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:26.970767 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127618) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 03:51:27.239542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:27.240190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:27.247158 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:27.247750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:27.248254 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:27.249014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:27.249537 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:27.250023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:27.302364 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-78bfde50-3b6c-4fc5-8cb9-b35c0a825001 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/action" status: 202 len: 0 microversion: 2.20 time: 0.392250 Sep 16 03:51:27.303542 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 229/440] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Sep 16 03:51:26 2022] POST /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:51:27.317565 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:27.318199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:27.330069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:27.330606 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:27.331888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:27.332624 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:27.333080 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:27.333545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:27.401622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:27.410628 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ee9ecd21-b31a-4ede-8afc-d0a4818db960 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1556 microversion: 2.1 time: 0.175080 Sep 16 03:51:27.411234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 212/441] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:51:27 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:51:27.433523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:27.434013 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:27.440675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:27.441388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:27.441639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:27.442296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:27.443230 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:27.443230 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:27.494843 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:27.505530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:27.507833 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:27.509019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-709bddb3-4437-4b87-94c1-0ba11ac5cc7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1749 microversion: 2.20 time: 0.201017 Sep 16 03:51:27.509578 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 230/442] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:27 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1749 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:51:27.537157 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f6de53f9-2c68-4b11-9768-289e1dae35a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107485 Sep 16 03:51:27.538352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 213/443] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 16 03:51:27 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:51:28.537991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:28.542390 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:28.546028 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:28.547060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:28.547566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:28.548349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:28.548858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:28.549493 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:28.580209 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:28.643685 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-e09b14e5-6e8e-4186-9b35-363a13e88f68 req-d27b4230-4a35-4551-a39d-c57e77dc1cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb8293f-e305-41ce-82f8-3a111fb43322", "tag": "ffb46fb6-10f2-412d-863b-b8a8006435ee"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:28.674421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-e09b14e5-6e8e-4186-9b35-363a13e88f68 req-d27b4230-4a35-4551-a39d-c57e77dc1cc4 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:28.674421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-e09b14e5-6e8e-4186-9b35-363a13e88f68 req-d27b4230-4a35-4551-a39d-c57e77dc1cc4 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:28.674421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-e09b14e5-6e8e-4186-9b35-363a13e88f68 req-d27b4230-4a35-4551-a39d-c57e77dc1cc4 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:28.676440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-e09b14e5-6e8e-4186-9b35-363a13e88f68 req-d27b4230-4a35-4551-a39d-c57e77dc1cc4 service nova] Creating event network-changed:ffb46fb6-10f2-412d-863b-b8a8006435ee for instance 4cb8293f-e305-41ce-82f8-3a111fb43322 on hv-cinder-85799 Sep 16 03:51:28.685578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-e09b14e5-6e8e-4186-9b35-363a13e88f68 req-d27b4230-4a35-4551-a39d-c57e77dc1cc4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043271 Sep 16 03:51:28.687230 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 214/444] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:28.734626 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:28.746444 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:28.749033 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:28.750562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c59a0145-ccd3-402e-8fbd-eaae4d773cea tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1749 microversion: 2.20 time: 0.216728 Sep 16 03:51:28.755587 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 231/445] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:28 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1749 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:29.779551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:29.780408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:29.799712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:29.799712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:29.799712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:29.799712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:29.800553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:29.800553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:29.936172 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:29.949830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:29.949830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:29.949830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-189f59f2-6848-4b30-aef3-bacc92ed1c0a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1751 microversion: 2.20 time: 0.174014 Sep 16 03:51:29.950197 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 215/446] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:29 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:51:30.975077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:30.975687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:31.000911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:31.000911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:31.000911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:31.000911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:31.001592 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:31.001592 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:31.144970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:31.157307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:31.159141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:31.160327 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d6bc027f-1549-44b9-8634-e087eef31b59 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1751 microversion: 2.20 time: 0.189563 Sep 16 03:51:31.160940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 232/447] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:30 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:32.187465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:32.188402 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:32.194962 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:32.195443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:32.195871 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:32.196561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:32.197066 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:32.197490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:32.334495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:32.343670 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:32.345131 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:32.346311 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b95a6d25-bf17-4b5a-b446-7e855fede908 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.164251 Sep 16 03:51:32.346874 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 216/448] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:32 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:33.002826 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d00f7456-fb09-49a8-b706-a4ee823280d2", "device": "/dev/sdb"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:51:33.005828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:33.012283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:33.012788 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:33.013583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:33.014293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:33.014747 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:33.015198 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:33.372480 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:33.373078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:33.379812 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:33.380432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:33.381221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:33.382283 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:33.382740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:33.383199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:33.605957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:33.615564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:33.619189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:33.622739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:33.624253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1bc1f55a-59c2-4f76-8ba1-016fdd9fa87a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.255878 Sep 16 03:51:33.642937 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 217/449] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:33 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:51:34.008130 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7fed6c33-8ab1-4eb4-9b06-e1371f8f050d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "POST /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.009371 Sep 16 03:51:34.015053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 233/450] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:51:32 2022] POST /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e/os-volume_attachments => generated 194 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:51:34.652752 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:34.653926 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:34.660617 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:34.661090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:34.661519 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:34.662198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:34.662645 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:34.663089 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:34.805100 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:34.814293 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:34.816755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:34.823044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a653b5b8-0b5b-46ea-93f3-247ee6a85f7a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.168798 Sep 16 03:51:34.823044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 218/451] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:34 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:35.843866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:35.844565 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:35.851544 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:35.852026 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:35.852459 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:35.853146 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:35.853597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:35.854018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:35.998771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:36.008580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:36.010164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:36.011506 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1f44aa61-ec52-48cd-9f76-ae4ef57e5676 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.172340 Sep 16 03:51:36.012065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 234/452] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:35 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:37.037345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:37.038038 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:37.045414 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:37.045891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:37.046330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:37.047049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:37.047545 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:37.047921 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:37.188317 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:37.197023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:37.198638 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:37.199701 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8e6e3b63-bd95-4e20-84b2-2195a091cafb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.166404 Sep 16 03:51:37.200254 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 219/453] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:37 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:38.226386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:38.227117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:38.235972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:38.236549 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:38.237051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:38.237793 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:38.240689 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:38.241245 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:38.374612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:38.383511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:38.385022 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:38.386235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b181b315-1bbc-47d8-a36b-0ba39509b2d0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.164248 Sep 16 03:51:38.386862 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 235/454] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:38 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:39.412352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:39.412976 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:39.415458 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=68 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:39.420552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:39.421038 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:39.421474 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:39.422173 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:39.422627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:39.423086 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:39.568702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:39.577780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:39.579277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:39.580478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0b0b2a42-4ea5-40ee-a492-8046890fcdd9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.171981 Sep 16 03:51:39.580992 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 220/455] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:39 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:40.617878 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:40.618465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:40.625350 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:40.625836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:40.626275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:40.627004 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:40.627461 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:40.627887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:40.762272 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:40.776239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:40.777670 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:40.779606 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cdefdccb-84b3-4d34-8b7c-b9ccf93a7395 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.170856 Sep 16 03:51:40.780155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 236/456] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:40 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:41.805275 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:41.805913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:41.812763 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:41.813248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:41.813680 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:41.814373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:41.814821 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:41.815331 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:41.946921 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:41.955922 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:41.957485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:41.958741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4b5b9e34-aea6-4a23-80ad-d7445c807414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.157757 Sep 16 03:51:41.959755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 221/457] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:41 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:42.986181 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:42.986949 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:42.994744 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:42.995501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:42.995985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:42.996970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:42.997476 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:42.998678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:43.399423 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:43.408771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:43.410232 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:43.411439 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0dfd6d81-3afc-4bd1-bc71-3a1b2de7057a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.429693 Sep 16 03:51:43.412002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 237/458] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:42 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:44.437909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:44.438524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:44.441208 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 03:51:44.441341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Fri Sep 16 03:51:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b (ip 10.222.0.49) !!! Sep 16 03:51:44.449114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:44.449601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:44.450039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:44.450727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:44.451209 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:44.451634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:44.594069 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:44.603033 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:44.604494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:44.605832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b0694bd7-12b8-4dd9-af2e-0a424328f13c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.172650 Sep 16 03:51:44.606393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 222/459] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:44 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:45.632685 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:45.633261 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:45.639862 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:45.640349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:45.640786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:45.641482 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:45.641963 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:45.642389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:45.775655 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:45.786184 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:45.787662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:45.788828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fbe0d9e2-0b3c-49d8-af2f-572fdef88af1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.160091 Sep 16 03:51:45.789374 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 238/460] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:45 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:46.814890 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:46.815645 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:46.822121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:46.822627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:46.823114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:46.823835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:46.825069 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:46.825543 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:46.961286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:46.970569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:46.972042 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:46.973305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e81accc1-202e-4513-a42e-9d91b2ec0242 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.162931 Sep 16 03:51:46.973944 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 223/461] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:46 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:47.999005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:47.999834 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:48.006148 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:48.006625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:48.007082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:48.007766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:48.008211 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:48.008628 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:48.140726 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:48.149585 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:48.151086 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:48.152258 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-89e51249-799e-4d7b-b42a-81785ef14271 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.157341 Sep 16 03:51:48.152813 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 239/462] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:47 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:49.178125 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:49.178736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:49.185434 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:49.185914 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:49.186347 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:49.187996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:49.188451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:49.188876 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:49.317040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:49.326133 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:49.327983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:49.329173 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ee0d365a-b6c5-4ff8-9e35-bc4d38797042 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.154945 Sep 16 03:51:49.329737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 224/463] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:49 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:50.355123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:50.355729 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:50.362789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:50.363296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:50.363724 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:50.364400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:50.364843 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:50.365257 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:50.493568 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:50.503070 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:50.504529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:50.505791 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-00d2bfe3-752f-4cd9-889f-08245ac358c6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.154610 Sep 16 03:51:50.506357 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 240/464] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:50 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:51.531189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:51.531795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:51.538221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:51.538698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:51.539156 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:51.539872 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:51.540314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:51.540731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:51.671551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:51.680639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:51.682093 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:51.683313 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-014d64a1-5311-4e10-b9fa-0807b44a0f7b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.156064 Sep 16 03:51:51.684064 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 225/465] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:51 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:52.709045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:52.709651 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:52.716094 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:52.716577 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:52.717044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:52.718283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:52.718742 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:52.719191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:52.848459 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:52.856985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:52.858596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:52.859830 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-641ff680-3bc5-40ad-bad8-28b64249cb38 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.154705 Sep 16 03:51:52.860386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 241/466] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:52 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:53.884748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:53.885350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:53.891915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:53.892390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:53.892820 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:53.893593 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:53.894042 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:53.894459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:54.024221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:54.033243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:54.034686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:54.035879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-67aa659d-13cb-4634-8b29-e7ebe605b5a5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.155064 Sep 16 03:51:54.036441 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 226/467] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:53 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:55.062365 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:55.063035 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:55.069801 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:55.076353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:55.076353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:55.076353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:55.076353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:55.076720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:55.205387 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:55.214260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:55.215757 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:55.216910 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4b14d2ac-3ba1-4711-be3f-274e5cc129ba tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.159241 Sep 16 03:51:55.217463 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 242/468] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:55 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:56.242444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:56.243077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:56.249155 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:56.249630 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:56.250112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:56.250794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:56.251276 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:56.251695 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:56.382567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:56.397755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:56.399222 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:56.400403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-33ec8469-5725-4044-8725-119610e75bbb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.162009 Sep 16 03:51:56.400963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 227/469] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:56 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:57.426492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:57.427137 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:57.429819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:57.434496 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:57.435003 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:57.435437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:57.436123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:57.437448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:57.438008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:57.567068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:57.575850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:57.577375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:57.578847 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5c58a9e5-e32e-487a-a45a-6b59c0b0a2aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.156253 Sep 16 03:51:57.579384 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 243/470] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:57 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:58.603826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:58.604364 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:58.606785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 03:51:58.606948 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Fri Sep 16 03:51:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b (ip 10.222.0.49) !!! Sep 16 03:51:58.613855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:58.615096 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:58.615096 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:58.615463 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:58.615906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:58.616322 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:58.746020 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:58.755523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:58.756961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:58.758117 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-acf8da66-de4e-4c62-bfc3-d104edeb4467 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.158310 Sep 16 03:51:58.758676 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 228/471] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:58 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:51:59.783358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:51:59.783963 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:51:59.790230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:59.790822 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:59.791286 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:59.791966 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:51:59.792410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:51:59.792831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:51:59.924087 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:59.932994 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:59.934484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:51:59.935851 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-369c6e9b-9211-4dd0-ab0f-7b1165df6e6c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.156447 Sep 16 03:51:59.936618 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 244/472] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:51:59 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:00.174435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a6387d70-a6be-4c4a-b774-9b5fcf64096c req-e209b655-5139-4929-bff1-032babfa1cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230b59e9-09d0-4448-a6a6-a395823fcd8b", "name": "network-vif-plugged", "status": "completed", "tag": "a04cc8c1-86e6-4381-8e36-de59ce5d9321"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:00.185143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6387d70-a6be-4c4a-b774-9b5fcf64096c req-e209b655-5139-4929-bff1-032babfa1cc8 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:00.185626 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6387d70-a6be-4c4a-b774-9b5fcf64096c req-e209b655-5139-4929-bff1-032babfa1cc8 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:00.186080 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6387d70-a6be-4c4a-b774-9b5fcf64096c req-e209b655-5139-4929-bff1-032babfa1cc8 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:00.197910 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a6387d70-a6be-4c4a-b774-9b5fcf64096c req-e209b655-5139-4929-bff1-032babfa1cc8 service nova] Creating event network-vif-plugged:a04cc8c1-86e6-4381-8e36-de59ce5d9321 for instance 230b59e9-09d0-4448-a6a6-a395823fcd8b on hv-cinder-85799 Sep 16 03:52:00.203206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a6387d70-a6be-4c4a-b774-9b5fcf64096c req-e209b655-5139-4929-bff1-032babfa1cc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Sep 16 03:52:00.204012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 229/473] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:00.962500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:00.963142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:00.969681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:00.970213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:00.970730 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:00.971638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:00.972091 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:00.972511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:00.988444 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:01.109520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:01.119025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:01.120466 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:01.121615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6f51a5ee-2338-4d8e-a458-1ae4591e9c15 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.163565 Sep 16 03:52:01.122165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 245/474] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:00 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:02.149730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:02.150433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:02.156567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:02.157049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:02.157485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:02.158691 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:02.159165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:02.159591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:02.298089 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:02.307995 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:02.309433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:02.310601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-93493a21-3dde-4dbd-a1e9-1fec22c2be5a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.165870 Sep 16 03:52:02.311182 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 230/475] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:02 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:03.336587 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:03.337197 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:03.343644 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:03.344125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:03.344557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:03.346001 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:03.346673 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:03.347131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:03.475741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:03.484130 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:03.485562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:03.486920 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a9bf4e3c-c575-494b-a059-2a6e113256c0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.154224 Sep 16 03:52:03.487488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 246/476] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:03 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:04.512840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:04.513485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:04.520384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:04.520906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:04.521345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:04.522350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:04.522493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:04.522874 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:04.651557 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:04.660571 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:04.662019 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:04.663210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e4a850cf-0c7a-424c-906b-7b4774d83565 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.154286 Sep 16 03:52:04.663767 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 231/477] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:04 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:05.688257 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:05.688859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:05.695904 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:05.696379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:05.698856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:05.698856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:05.698856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:05.698856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:05.828435 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:05.837845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:05.839369 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:05.840510 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-583e9b67-98c9-437e-8229-8796305c793d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.156223 Sep 16 03:52:05.841060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 247/478] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:05 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:06.867139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:06.867792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:06.874180 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:06.874657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:06.875129 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:06.875813 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:06.876256 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:06.876674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:07.007010 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:07.015588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:07.017034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:07.019355 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3ca80dbd-99da-4925-aef3-0917d2687ec0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.156159 Sep 16 03:52:07.019901 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 232/479] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:06 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:08.044894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:08.045676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:08.052934 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:08.053415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:08.053843 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:08.054891 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:08.055359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:08.055779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:08.186457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:08.195471 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:08.196901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:08.198038 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-142a0843-b223-4270-9e30-216914688140 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.157104 Sep 16 03:52:08.198588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 248/480] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:08 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:09.224546 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:09.225139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:09.231575 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:09.232056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:09.232490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:09.233171 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:09.233619 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:09.234039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:09.237714 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=87 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:09.381827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:09.391513 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:09.393156 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:09.394540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e0958af3-382e-41f9-b72d-7eca4146ee3c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.175083 Sep 16 03:52:09.395398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 233/481] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:09 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:10.421541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:10.422170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:10.430105 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:10.430612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:10.431068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:10.431766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:10.432219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:10.432642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:10.570771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:10.579765 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:10.581262 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:10.582434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-13e8e6f8-c7c3-4d6e-8a85-0f9d92a8a76b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1807 microversion: 2.20 time: 0.165092 Sep 16 03:52:10.583018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 249/482] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:10 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:11.607703 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:11.608319 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:11.610846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=28 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:11.615567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:11.616027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:11.616454 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:11.617132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:11.617578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:11.617990 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:11.746535 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:11.755886 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:11.757400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:11.758564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-21d02dc6-05f7-4140-8dab-d486034af906 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1794 microversion: 2.20 time: 0.154985 Sep 16 03:52:11.764493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 234/483] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:11 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:13.698530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:13.707522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:13.707522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:13.707522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:13.707522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:13.707980 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:13.707980 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:13.707980 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:13.833221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lazy-loading 'services' on Instance uuid 3d4ab7b5-8592-4a8b-bff6-d7316c09755e {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:52:14.052581 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b8c77297-1e79-422d-b703-31693da7bc06 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e/os-volume_attachments/d00f7456-fb09-49a8-b706-a4ee823280d2" status: 202 len: 0 microversion: 2.1 time: 0.357726 Sep 16 03:52:14.053183 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 250/484] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:52:13 2022] DELETE /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e/os-volume_attachments/d00f7456-fb09-49a8-b706-a4ee823280d2 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:52:16.237406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:16.237928 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:16.244637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:16.245126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:16.245564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:16.246258 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:16.246712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:16.247296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:16.273421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:52:16.584773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5ab7d025-bfe7-43b7-824e-bed649594c54 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 204 len: 0 microversion: 2.1 time: 0.350672 Sep 16 03:52:16.585360 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 235/485] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:52:16 2022] DELETE /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:52:16.594550 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:16.595878 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:16.602375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:16.602878 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:16.605772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:16.605772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:16.605772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:16.605772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:16.737320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:16.745645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-80018c7a-450f-4d2f-9f06-8cf012903917 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1514 microversion: 2.1 time: 0.155864 Sep 16 03:52:16.746204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 251/486] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:16 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:17.768702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:17.769396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:17.779636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:17.780119 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:17.780552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:17.781249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:17.781699 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:17.782134 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:17.912993 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:17.920907 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-542902a2-54ff-4947-a4d7-92804df31113 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1514 microversion: 2.1 time: 0.156493 Sep 16 03:52:17.921465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 236/487] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:17 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:18.944956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:18.945598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:18.951511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:18.952096 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:18.952533 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:18.953215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:18.953659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:18.954075 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:19.028830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:19.029407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:19.035931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:19.036511 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:19.037519 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:19.038228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:19.038684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:19.039148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:19.126713 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:19.136058 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a5cc8395-d6da-4d7b-b621-626920d75b77 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1514 microversion: 2.1 time: 0.195778 Sep 16 03:52:19.148118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 252/488] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:18 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:19.171428 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'services' on Instance uuid 2df7ed3f-dd6d-4312-a548-591443add019 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:52:19.242303 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-a25c275e-72f0-4752-8ae8-7565f13d703b req-63be26ce-aa1b-4b65-b2c9-460bb0da0a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4ab7b5-8592-4a8b-bff6-d7316c09755e", "name": "network-vif-deleted", "tag": "5531f7a3-f8a9-4c79-b05c-b2ef4472f8fc"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:19.252544 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a25c275e-72f0-4752-8ae8-7565f13d703b req-63be26ce-aa1b-4b65-b2c9-460bb0da0a7f service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:19.253025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a25c275e-72f0-4752-8ae8-7565f13d703b req-63be26ce-aa1b-4b65-b2c9-460bb0da0a7f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:19.253458 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a25c275e-72f0-4752-8ae8-7565f13d703b req-63be26ce-aa1b-4b65-b2c9-460bb0da0a7f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:19.267927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-a25c275e-72f0-4752-8ae8-7565f13d703b req-63be26ce-aa1b-4b65-b2c9-460bb0da0a7f service nova] Creating event network-vif-deleted:5531f7a3-f8a9-4c79-b05c-b2ef4472f8fc for instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e on hv-cinder-85799 Sep 16 03:52:19.273064 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-a25c275e-72f0-4752-8ae8-7565f13d703b req-63be26ce-aa1b-4b65-b2c9-460bb0da0a7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035887 Sep 16 03:52:19.273675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 253/489] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:52:19.409206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-02842beb-aaa0-4bd9-91f4-1fb50c49b29d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/os-volume_attachments/cd66a66e-98fa-47d8-8966-34490d65f52e" status: 202 len: 0 microversion: 2.1 time: 0.384705 Sep 16 03:52:19.409804 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 237/490] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:52:19 2022] DELETE /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/os-volume_attachments/cd66a66e-98fa-47d8-8966-34490d65f52e => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 03:52:20.161281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:20.162012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:20.168697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:20.169186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:20.169821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:20.170565 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:20.171056 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:20.171483 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:20.205499 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:20.206032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:20.206418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:20.206864 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lazy-loading 'fault' on Instance uuid 3d4ab7b5-8592-4a8b-bff6-d7316c09755e {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:52:20.259065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:20.266735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c307b169-d8b8-4c79-96eb-f13048488212 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 200 len: 1309 microversion: 2.1 time: 0.110192 Sep 16 03:52:20.267362 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 254/491] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:20 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:21.289720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:21.290402 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 3d4ab7b5-8592-4a8b-bff6-d7316c09755e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:21.296507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:21.296983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:21.297411 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:21.298085 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:21.298527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:21.298967 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:21.315637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] HTTP exception thrown: Instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e could not be found. Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Request method failure captured: Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e HTTP/1.1 Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_KWCxiAZpqMCtUVHWdNqLis39A2ud0GgDOuwqdkBsLiWJiI9hW6RT95HEjbpxoLndlcVrIjbac6Yaybn8p3O408JA9S_NW8K-5SWQB_7b78PuYxz4FT8JW1x8ODip8zMA3aUBiSitX2ou5EFku7sYUvkWQ7nsUqEDEPN6eLOWkE8Lk Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 0ea684aa585e4b4483261a014d861cb1 Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotTestJSON-246206017 Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:52:21.317400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ea684aa585e4b4483261a014d861cb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0ea684aa585e4b4483261a014d861cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0ea684aa585e4b4483261a014d861cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ea684aa585e4b4483261a014d861cb1"}]}] Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotTestJSON-246206017 Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 0ea684aa585e4b4483261a014d861cb1 Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-246206017 Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotTestJSON-246206017-project Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5691b0a2de144779b3b9a276f4f9aa79 Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotTestJSON-246206017-project Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e could not be found. Sep 16 03:52:21.319417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '3d4ab7b5-8592-4a8b-bff6-d7316c09755e'} Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e could not be found. Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:52:21.320195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e could not be found. Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e could not be found. Sep 16 03:52:21.321401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:21.322484 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Returning 404 to user: Instance 3d4ab7b5-8592-4a8b-bff6-d7316c09755e could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:52:21.322484 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-552d8132-d58d-4b69-a052-e51ff7439cff tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e" status: 404 len: 111 microversion: 2.1 time: 0.034526 Sep 16 03:52:21.322484 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 238/492] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:21 2022] GET /compute/v2.1/servers/3d4ab7b5-8592-4a8b-bff6-d7316c09755e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:52:21.595209 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ef898123-843a-4455-b4d6-10bf3c5ba581 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:21.602017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef898123-843a-4455-b4d6-10bf3c5ba581 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:21.602503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef898123-843a-4455-b4d6-10bf3c5ba581 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:21.602959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef898123-843a-4455-b4d6-10bf3c5ba581 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:21.625360 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef898123-843a-4455-b4d6-10bf3c5ba581 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Going to try to stop instance {{(pid=127618) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 03:52:21.849977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ef898123-843a-4455-b4d6-10bf3c5ba581 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/action" status: 202 len: 0 microversion: 2.1 time: 0.258233 Sep 16 03:52:21.850516 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 255/493] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:52:21 2022] POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:52:21.858801 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:21.859468 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:21.866496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:21.867050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:21.867495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:21.868191 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:21.868672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:21.869095 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:22.013799 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:22.021448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8fb094f9-64a7-4fb8-9eb7-61dcec013b6e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.166621 Sep 16 03:52:22.021999 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 239/494] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:21 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:23.044786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:23.045397 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:23.051887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:23.052358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:23.053379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:23.054046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:23.054486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:23.055198 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:23.185968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:23.193992 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-61337e00-65dc-48a3-a5b8-fad99c422c03 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.153343 Sep 16 03:52:23.194627 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 256/495] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:23 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:23.979331 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db7fc0d4-321f-44e8-8490-cdb726141bd5"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:23.983527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:23.991565 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:23.992049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:23.992486 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:23.993173 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:23.993627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:23.994045 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:24.218746 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:24.219393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:24.226466 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:24.226966 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:24.227402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:24.228084 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:24.228529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:24.228948 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:24.362808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:24.371456 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7099e523-24ac-469f-9334-38482ce05f02 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.156616 Sep 16 03:52:24.372015 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 257/496] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:24 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:25.394208 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:25.394875 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:25.402353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:25.405940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:25.405940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:25.405940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:25.405940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:25.406332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:25.528809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0aba48a2-596a-479f-a8ec-87947375c0ee tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.553375 Sep 16 03:52:25.529851 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 240/497] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:52:23 2022] POST /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments => generated 194 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:25.589930 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:25.597921 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-321bdf9f-1d84-4664-8bec-c89df61062fe tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.207541 Sep 16 03:52:25.601021 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 258/498] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:25 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:26.623520 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:26.624481 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:26.631629 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:26.632270 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:26.632712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:26.633503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:26.633956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:26.634476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:26.775728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:26.783408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f8d1036e-9e0e-4667-b9e6-e01fbcff9b67 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.165628 Sep 16 03:52:26.784151 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 241/499] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:26 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:27.024347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:27.024894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:27.031236 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.031715 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.032151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.032844 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.033296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.033720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.059544 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-afb6f2d8-3b34-498a-8852-b9f90a0a0143 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322/ips" status: 200 len: 150 microversion: 2.1 time: 0.039269 Sep 16 03:52:27.060095 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 259/500] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:52:27 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:27.072510 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0251c7e9-57b2-4f1b-bff8-a921825d1e56"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:27.074947 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:27.081028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.081517 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.082077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.083301 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.084162 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.084930 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.166051 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Invalid volume: volume 0251c7e9-57b2-4f1b-bff8-a921825d1e56 is already attached to instances: 6fee7fbd-189b-4a53-ba78-d66512c7b09d Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322/os-volume_attachments HTTP/1.1 Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 74 Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:52:27.167807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {"volumeAttachment": {"volumeId": "0251c7e9-57b2-4f1b-bff8-a921825d1e56"}} Sep 16 03:52:27.169438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Invalid volume: volume 0251c7e9-57b2-4f1b-bff8-a921825d1e56 is already attached to instances: 6fee7fbd-189b-4a53-ba78-d66512c7b09d Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '4cb8293f-e305-41ce-82f8-3a111fb43322', 'body': {'volumeAttachment': {'volumeId': '0251c7e9-57b2-4f1b-bff8-a921825d1e56'}}} Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0251c7e9-57b2-4f1b-bff8-a921825d1e56 is already attached to instances: 6fee7fbd-189b-4a53-ba78-d66512c7b09d Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:27.173807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0251c7e9-57b2-4f1b-bff8-a921825d1e56 is already attached to instances: 6fee7fbd-189b-4a53-ba78-d66512c7b09d Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:27.175257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:27.177352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:27.177352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:52:27.177352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:52:27.177352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0251c7e9-57b2-4f1b-bff8-a921825d1e56 is already attached to instances: 6fee7fbd-189b-4a53-ba78-d66512c7b09d Sep 16 03:52:27.177352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:52:27.177352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 400 to user: Invalid volume: volume 0251c7e9-57b2-4f1b-bff8-a921825d1e56 is already attached to instances: 6fee7fbd-189b-4a53-ba78-d66512c7b09d {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:52:27.177352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-870055c5-6612-4e69-8cb2-6d6306cb5287 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101546 Sep 16 03:52:27.177352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 242/501] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:52:27 2022] POST /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:52:27.180821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:27.181315 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:27.187203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.187681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.188114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.188906 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.189226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.189643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.215339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:52:27.230187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:27.518371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e98055e2-4921-4dcb-8ca9-2291428071a9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 204 len: 0 microversion: 2.1 time: 0.342165 Sep 16 03:52:27.518972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 260/502] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:52:27 2022] DELETE /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:52:27.527449 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:27.528058 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:27.534672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.535190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.535626 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.536306 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.536756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.538121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.677676 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:27.686574 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c64df6cd-db6b-4bca-956d-7e9f399f3069 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1681 microversion: 2.1 time: 0.162882 Sep 16 03:52:27.687267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 243/503] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:27 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:27.806592 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:27.807317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:27.809501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:27.814555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.819820 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.819820 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.819820 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:27.819820 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:27.820173 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:27.949709 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:27.957511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-07e0f8ac-4932-4d54-b5b8-17a6bcc6fd73 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.155646 Sep 16 03:52:27.958075 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 261/504] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:27 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:28.712222 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:28.712831 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:28.719282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:28.719761 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:28.720194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:28.720869 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:28.721354 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:28.721772 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:28.849416 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:28.857655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8e74c7fe-f9da-49a3-b4d4-d77a2a5d39b9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1681 microversion: 2.1 time: 0.149820 Sep 16 03:52:28.858217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 244/505] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:28 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:28.982089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:28.982690 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:28.988961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:28.989435 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:28.989866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:28.990543 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:28.991019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:28.992093 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:29.136246 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:29.143939 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1210bf0c-00a4-4ae9-b6a1-8f97a4c87430 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.166042 Sep 16 03:52:29.144506 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 262/506] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:28 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:29.881517 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:29.882135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:29.889309 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:29.889793 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:29.890226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:29.890940 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:29.891395 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:29.891815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:30.024681 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:30.032374 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-90877f5d-7e39-4844-93cf-48f7de311513 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1681 microversion: 2.1 time: 0.154714 Sep 16 03:52:30.032931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 245/507] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:29 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:30.168964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:30.169569 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:30.176158 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:30.176634 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:30.177066 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:30.177753 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:30.178212 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:30.178714 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:30.310543 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:30.318240 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6ad75bea-21d4-4880-8bf1-cc36fc9738bd tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.153666 Sep 16 03:52:30.318801 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 263/508] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:30 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:31.056119 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:31.056643 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:31.063027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:31.063507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:31.063930 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:31.064608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:31.065053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:31.065468 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:31.194498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:31.196869 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:31.204174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f249f606-2013-457d-9b5a-b5d402b1546e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1681 microversion: 2.1 time: 0.152292 Sep 16 03:52:31.204734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 246/509] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:31 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:31.341697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:31.342467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:31.349189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:31.349673 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:31.350106 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:31.350803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:31.351285 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:31.351707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:31.642503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:31.650402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-236e7224-0ccc-433a-bbb8-94c3d4f0ba19 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.312674 Sep 16 03:52:31.653519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 264/510] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:31 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:31.858408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-543046825", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "networks": [{"uuid": "b5f7c9d9-2726-47bd-8b35-89fb0951bd43"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:31.922325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] validate_networks() for [('b5f7c9d9-2726-47bd-8b35-89fb0951bd43', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:52:32.172671 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-7a23930a-2aae-4e07-b3f1-917197a6e886 req-015ab278-b21a-47b9-bd14-7ba7133989e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb8293f-e305-41ce-82f8-3a111fb43322", "name": "network-vif-deleted", "tag": "ffb46fb6-10f2-412d-863b-b8a8006435ee"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:32.182981 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7a23930a-2aae-4e07-b3f1-917197a6e886 req-015ab278-b21a-47b9-bd14-7ba7133989e6 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:32.183827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7a23930a-2aae-4e07-b3f1-917197a6e886 req-015ab278-b21a-47b9-bd14-7ba7133989e6 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:32.184474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7a23930a-2aae-4e07-b3f1-917197a6e886 req-015ab278-b21a-47b9-bd14-7ba7133989e6 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:32.198354 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-7a23930a-2aae-4e07-b3f1-917197a6e886 req-015ab278-b21a-47b9-bd14-7ba7133989e6 service nova] Creating event network-vif-deleted:ffb46fb6-10f2-412d-863b-b8a8006435ee for instance 4cb8293f-e305-41ce-82f8-3a111fb43322 on hv-cinder-85799 Sep 16 03:52:32.204238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-7a23930a-2aae-4e07-b3f1-917197a6e886 req-015ab278-b21a-47b9-bd14-7ba7133989e6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034894 Sep 16 03:52:32.205525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 265/511] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:52:32.229115 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:32.235977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:32.251600 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:32.253340 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:32.254381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:32.255382 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:32.256112 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:32.256769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:32.337610 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:52:32.337610 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:52:32.338162 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:52:32.338266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:52:32.338624 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:52:32.363919 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:32.364412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:32.364850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:32.365576 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:32.366032 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:32.366305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:32.366727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:32.376955 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f6b892f3-2563-46a5-85b2-c3938fe75d89 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1613 microversion: 2.1 time: 0.152308 Sep 16 03:52:32.377924 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 266/512] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:32 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:32.389140 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Getting quotas for project 0ea684aa585e4b4483261a014d861cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:52:32.393817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Getting quotas for user 5691b0a2de144779b3b9a276f4f9aa79 and project 0ea684aa585e4b4483261a014d861cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:52:32.406456 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:52:32.408741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:52:32.586037 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-46e1bdb0-6217-444c-98ca-22c321b14901 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732444 Sep 16 03:52:32.588684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 247/513] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:52:32.599567 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7e8c00b6-f7db-45d1-aeed-7e1b62d357eb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:32.600837 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7e8c00b6-f7db-45d1-aeed-7e1b62d357eb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:32.673959 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:32.674584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:32.683343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:32.684264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:32.684716 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e8c00b6-f7db-45d1-aeed-7e1b62d357eb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:32.685186 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:32.686131 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:32.686841 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:32.687511 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:32.696429 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7e8c00b6-f7db-45d1-aeed-7e1b62d357eb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1218 microversion: 2.1 time: 0.100590 Sep 16 03:52:32.698293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 267/514] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:32 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:32.874244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:32.884598 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6bcc3441-736c-48bf-863f-ddf854489071 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.215054 Sep 16 03:52:32.885526 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 248/515] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:32 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:33.401698 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:33.404125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:33.419482 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:33.420129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:33.420898 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:33.422583 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:33.423532 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:33.424455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:33.465596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:33.466484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:33.467014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:33.467443 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lazy-loading 'fault' on Instance uuid 4cb8293f-e305-41ce-82f8-3a111fb43322 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:52:33.517498 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:33.530821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3ee647b9-ef6c-4748-b03d-0891ccede2a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 200 len: 1330 microversion: 2.1 time: 0.133031 Sep 16 03:52:33.532165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 268/516] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:33 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:33.721415 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:33.722106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:33.731623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:33.731623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:33.732090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:33.733045 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:33.733652 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:33.734249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:33.809810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:33.820367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e1de4333-2aee-4e19-8cf1-2c5b90a29e3e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1222 microversion: 2.1 time: 0.103530 Sep 16 03:52:33.820956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 249/517] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:33 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:33.911067 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:33.912178 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:33.920151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:33.921373 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:33.922185 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:33.923751 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:33.924536 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:33.925114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.080860 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:34.090501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-377e549a-e3eb-480d-84e1-ed1293db5e7e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.183132 Sep 16 03:52:34.095477 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 269/518] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:33 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:34.219639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:34.222021 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:34.228957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:34.229445 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:34.230130 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.230693 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:34.231177 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:34.231609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.254973 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lazy-loading 'flavor' on Instance uuid aa7bab22-1639-467d-ba7a-94c97e1b9231 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:52:34.561183 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:34.562093 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:34.572679 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:34.573317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:34.574484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.575193 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:34.575640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:34.576061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 HTTP/1.1 Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:52:34.594234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:52:34.596052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '4cb8293f-e305-41ce-82f8-3a111fb43322'} Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:52:34.596799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:52:34.597945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:34.599418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:52:34.599418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-39c7e927-4692-42cb-bf34-62e86997c3a1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 404 len: 111 microversion: 2.1 time: 0.037153 Sep 16 03:52:34.599418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 270/519] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:34 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 03:52:34.602662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-90f39266-0d3b-4293-bbb9-6cbabe90ade9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '.version_select at 0x7fba7c838550>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:34.668405 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-53291834-de77-40be-b8fb-dfe14ffef885 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/action" status: 200 len: 32 microversion: 2.1 time: 0.452860 Sep 16 03:52:34.673411 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 250/520] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:52:34 2022] POST /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 03:52:34.679084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:34.680284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:34.691145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:34.691672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:34.692125 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.692840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:34.693302 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:34.693728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.694143 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-90f39266-0d3b-4293-bbb9-6cbabe90ade9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705365470" status: 202 len: 0 microversion: 2.1 time: 0.094766 Sep 16 03:52:34.695225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 271/521] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 16 03:52:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705365470 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:52:34.844037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:34.844634 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:34.851470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:34.852020 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:34.852464 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.853166 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:34.853614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:34.857920 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:34.900731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:34.909288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ad9ea618-76b9-4311-8289-d8642a27adf2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.234600 Sep 16 03:52:34.909859 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 251/522] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:34 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:34.920684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:34.929118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-38809b3e-b34a-48f8-af2e-18a4cd5d90f3 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1270 microversion: 2.1 time: 0.089089 Sep 16 03:52:34.929673 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 272/523] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:34 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:35.113935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:35.114974 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:35.122071 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:35.122646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:35.123183 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:35.123959 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:35.124632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:35.125370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:35.306550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:35.320679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9002b8b1-704b-4970-9195-69cd4f79a3b8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.210874 Sep 16 03:52:35.321340 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 252/524] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:35 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:35.934504 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:35.934957 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:35.949933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:35.952548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:35.958327 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:35.958955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:35.962398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:35.963292 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:35.967180 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:35.967662 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:35.968089 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:35.968778 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:35.969222 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:35.969639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:35.973893 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:35.974334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:36.107394 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:36.116331 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e0e70a62-0881-4b00-9edf-8f7145fb90c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.186817 Sep 16 03:52:36.121084 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 273/525] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:35 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:36.121943 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:36.122612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:36.129970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:36.130665 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:36.131285 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:36.132150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:36.132764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:36.133185 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:36.211149 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:36.221280 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7761cf18-170c-4714-801a-2b6739b246f5 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1318 microversion: 2.1 time: 0.267002 Sep 16 03:52:36.222071 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 253/526] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:35 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:36.226679 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lazy-loading 'services' on Instance uuid 6fee7fbd-189b-4a53-ba78-d66512c7b09d {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:52:36.345056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:36.345673 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:36.351726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:36.353544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:36.353544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:36.353544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:36.353839 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:36.354139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:36.467666 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dc41da69-9e94-464c-8aa9-b2098ae5a5d9 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments/0251c7e9-57b2-4f1b-bff8-a921825d1e56" status: 202 len: 0 microversion: 2.1 time: 0.349514 Sep 16 03:52:36.468404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 274/527] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:52:36 2022] DELETE /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments/0251c7e9-57b2-4f1b-bff8-a921825d1e56 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:52:36.477539 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:36.480147 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:36.487087 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:36.487650 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:36.488154 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:36.488860 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:36.489316 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:36.489797 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:36.521219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-14133826-32f3-49af-b7f5-4d1ceb3f6b18 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048004 Sep 16 03:52:36.521970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 275/528] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:52:36 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:52:36.603679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:36.612252 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-69f5e917-04d8-4c8b-a3cd-f6ee6663a513 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1676 microversion: 2.1 time: 0.271152 Sep 16 03:52:36.612824 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 254/529] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:36 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1676 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:37.140852 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:37.141403 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:37.147947 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.148428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.148859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.149544 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.149861 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-904ad970-06ff-413c-a79e-c934a25abd0c req-179b0b7c-531f-4ad5-ad65-ae9749575a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e433d47-53b8-4ba1-b28d-ad599d89bbf2", "tag": "3488f17c-8711-4a76-babc-e20b6596afc9"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:37.150323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.150439 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.175200 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-904ad970-06ff-413c-a79e-c934a25abd0c req-179b0b7c-531f-4ad5-ad65-ae9749575a49 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.175200 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-904ad970-06ff-413c-a79e-c934a25abd0c req-179b0b7c-531f-4ad5-ad65-ae9749575a49 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.175200 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-904ad970-06ff-413c-a79e-c934a25abd0c req-179b0b7c-531f-4ad5-ad65-ae9749575a49 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.182204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-904ad970-06ff-413c-a79e-c934a25abd0c req-179b0b7c-531f-4ad5-ad65-ae9749575a49 service nova] Creating event network-changed:3488f17c-8711-4a76-babc-e20b6596afc9 for instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 on hv-cinder-85799 Sep 16 03:52:37.189302 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-904ad970-06ff-413c-a79e-c934a25abd0c req-179b0b7c-531f-4ad5-ad65-ae9749575a49 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044747 Sep 16 03:52:37.190323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 255/530] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:52:37.256303 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:37.256923 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:37.263375 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.263868 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.264314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.265013 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.265467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.265891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.347998 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:37.357686 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8b6026ef-4e61-4290-afe7-acf1411d3393 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.220699 Sep 16 03:52:37.358269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 276/531] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:37 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:37.488916 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:37.497493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8dbb74c8-6294-4b7a-b578-84adfc46b411 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1318 microversion: 2.1 time: 0.248955 Sep 16 03:52:37.498177 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 256/532] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:37 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:37.534333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:37.536506 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:37.543299 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.543789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.544230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.545019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.545486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.545898 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.577226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-97c0ea36-9b16-487b-99a6-b328c553b08a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Sep 16 03:52:37.577799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 277/533] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:52:37 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:37.641107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:37.641792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:37.647755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.648237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.648667 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.649407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.649801 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.650216 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.853871 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:37.862509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0e4bec4f-bc42-4d1b-9b8d-6a1d220e3d3a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1653 microversion: 2.1 time: 0.226233 Sep 16 03:52:37.863109 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 257/534] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:37 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1653 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:37.884638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-838a14e0-ce49-4fef-bbfe-e5c17fb59f14 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:37.892063 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-838a14e0-ce49-4fef-bbfe-e5c17fb59f14 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:37.892557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-838a14e0-ce49-4fef-bbfe-e5c17fb59f14 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:37.892994 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-838a14e0-ce49-4fef-bbfe-e5c17fb59f14 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:37.908589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:37.918860 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-838a14e0-ce49-4fef-bbfe-e5c17fb59f14 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Going to try to start instance {{(pid=127618) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 03:52:38.156775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-838a14e0-ce49-4fef-bbfe-e5c17fb59f14 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/action" status: 202 len: 0 microversion: 2.1 time: 0.275727 Sep 16 03:52:38.157425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 278/535] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:52:37 2022] POST /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:52:38.165758 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:38.166376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:38.173005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.173558 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.174021 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.174682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.175160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.175585 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.343866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:38.351490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-81986e0e-e2fa-49cf-bfae-c6e8b0ccc44b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1662 microversion: 2.1 time: 0.189757 Sep 16 03:52:38.352060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 258/536] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:38 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1662 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:38.382116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:38.382869 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:38.390582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.391096 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.391723 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.392415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.392859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.393277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.520794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:38.521772 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:38.527870 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.528350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.528881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.529566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.530029 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.530445 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.531658 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:38.539900 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a911cdfb-f552-48f5-9ef1-a8e56a04ce2a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.161972 Sep 16 03:52:38.540466 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 279/537] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:38 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:38.589698 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:38.591836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:38.597669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.598149 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.598579 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.599283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.599725 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.600141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.630325 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bc4e6b83-1c7d-4053-8406-b90321974475 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044511 Sep 16 03:52:38.630884 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 280/538] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:52:38 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 03:52:38.664723 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:38.673371 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-18498da7-d9eb-4d48-9e23-9e990e8ab907 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1318 microversion: 2.1 time: 0.156644 Sep 16 03:52:38.674031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 259/539] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:38 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:38.695415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:38.695906 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:38.702118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.702596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.703054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.703730 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:38.704176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:38.704589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:38.729282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:52:39.038127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4bfd3785-f390-4d24-a3d2-4e2358805a82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 204 len: 0 microversion: 2.1 time: 0.346244 Sep 16 03:52:39.038705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 281/540] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:52:38 2022] DELETE /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:52:39.047794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:39.048398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:39.054144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:39.054619 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:39.055347 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:39.056030 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:39.056478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:39.056896 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:39.189005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:39.196713 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-029df0ff-fbae-4950-a53b-6694d012d7a3 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1681 microversion: 2.1 time: 0.152762 Sep 16 03:52:39.197271 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 260/541] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:39 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:39.376421 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:39.377110 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:39.383668 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:39.384145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:39.384574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:39.385247 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:39.385693 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:39.386393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:39.519288 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:39.527949 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2788fc5f-2efc-4c41-aa3c-30cd117bbcf8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1662 microversion: 2.1 time: 0.155615 Sep 16 03:52:39.528523 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 282/542] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:39 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:39.563755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:39.564362 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:39.570325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:39.570807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:39.571277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:39.571959 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:39.572408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:39.572827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:39.696191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:39.696804 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:39.703281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:39.703763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:39.704193 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:39.705070 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:39.705520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:39.705942 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:39.717611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:39.725880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e8cf4c2d-8eaa-48d3-b087-71cc6a939351 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.165884 Sep 16 03:52:39.726786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 261/543] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:39 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:40.077053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:40.084577 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-39eebde8-3b2f-409f-9472-230b216b4355 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1318 microversion: 2.1 time: 0.392233 Sep 16 03:52:40.085118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 283/544] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:39 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:40.220914 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:40.221625 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:40.227919 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:40.228406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:40.228839 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:40.229533 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:40.230312 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:40.231023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:40.367212 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:40.369478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:40.376114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d932062e-0709-44b2-b339-4ebd70eabb1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1681 microversion: 2.1 time: 0.159233 Sep 16 03:52:40.376673 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 262/545] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:40 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:40.551642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:40.552232 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:40.559487 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:40.559960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:40.560390 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:40.561068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:40.561512 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:40.561926 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:40.694983 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:40.702805 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ac1164df-7f81-4b33-85c3-e0f73cf443be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1662 microversion: 2.1 time: 0.154987 Sep 16 03:52:40.703391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 284/546] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:40 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:40.750214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:40.750883 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:40.757425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:40.757908 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:40.758337 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:40.759047 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:40.759496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:40.759910 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:40.902118 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:40.910414 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0d6ff0a6-b0c2-4232-a5ff-dbf902f329c0 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.164148 Sep 16 03:52:40.910994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 263/547] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:40 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:41.108450 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:41.109055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:41.114916 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:41.115411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:41.115880 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:41.116557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:41.117003 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:41.117420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:41.253171 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:41.261074 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-499ac097-1bd2-4cdb-9418-070c4b687d83 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1318 microversion: 2.1 time: 0.157032 Sep 16 03:52:41.261640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 285/548] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:41 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:41.400193 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:41.400932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:41.408603 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:41.409201 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:41.409635 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:41.410325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:41.410775 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:41.411224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:41.683739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:41.691435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ddde371f-49f5-4904-aa38-2d60fbb55e82 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1681 microversion: 2.1 time: 0.295150 Sep 16 03:52:41.692184 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 264/549] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:41 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1681 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:41.729707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:41.730407 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:41.736757 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:41.737235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:41.737661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:41.738391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:41.738786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:41.739230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:41.870835 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:41.878736 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-242e8afb-49cd-4ada-831a-5e54b4be430f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1662 microversion: 2.1 time: 0.152936 Sep 16 03:52:41.879317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 286/550] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:41 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:41.935274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:41.935892 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:41.937732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:41.942517 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:41.943035 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:41.943476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:41.944172 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:41.944628 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:41.945137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:42.176758 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:42.187412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e6978c7f-3b26-4c39-9bc7-3ad51a236aa6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.256693 Sep 16 03:52:42.189302 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 265/551] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:41 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:42.284329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:42.284766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:42.290865 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:42.291371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:42.291802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:42.294735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:42.294735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:42.294735 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:42.382449 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-ac50c4cb-57a1-45c9-9be6-dc685ba9ba89 req-7d7d093b-e41f-411e-b7ac-f7378c6b387b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fee7fbd-189b-4a53-ba78-d66512c7b09d", "name": "network-vif-deleted", "tag": "0ec6698f-782e-4670-8cd3-efb57d7433ad"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:42.414622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:42.419264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:42.423727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ac50c4cb-57a1-45c9-9be6-dc685ba9ba89 req-7d7d093b-e41f-411e-b7ac-f7378c6b387b service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:42.424737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ac50c4cb-57a1-45c9-9be6-dc685ba9ba89 req-7d7d093b-e41f-411e-b7ac-f7378c6b387b service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:42.427645 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ac50c4cb-57a1-45c9-9be6-dc685ba9ba89 req-7d7d093b-e41f-411e-b7ac-f7378c6b387b service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:42.453279 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-ac50c4cb-57a1-45c9-9be6-dc685ba9ba89 req-7d7d093b-e41f-411e-b7ac-f7378c6b387b service nova] Creating event network-vif-deleted:0ec6698f-782e-4670-8cd3-efb57d7433ad for instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d on hv-cinder-85799 Sep 16 03:52:42.462492 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-ac50c4cb-57a1-45c9-9be6-dc685ba9ba89 req-7d7d093b-e41f-411e-b7ac-f7378c6b387b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086705 Sep 16 03:52:42.463997 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 266/552] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:42.515133 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:42.528069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c121f5b2-49fd-4be1-8f6f-771eb23b818a tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1318 microversion: 2.1 time: 0.247837 Sep 16 03:52:42.528856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 287/553] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:42 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:42.698126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-e58a77f8-2bd0-40f0-a57a-4eec1f9c0f1d req-f267238e-40ad-4ca1-be36-0f5d916f6841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e433d47-53b8-4ba1-b28d-ad599d89bbf2", "name": "network-vif-plugged", "status": "completed", "tag": "3488f17c-8711-4a76-babc-e20b6596afc9"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:42.708950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-e58a77f8-2bd0-40f0-a57a-4eec1f9c0f1d req-f267238e-40ad-4ca1-be36-0f5d916f6841 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:42.709425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-e58a77f8-2bd0-40f0-a57a-4eec1f9c0f1d req-f267238e-40ad-4ca1-be36-0f5d916f6841 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:42.710153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-e58a77f8-2bd0-40f0-a57a-4eec1f9c0f1d req-f267238e-40ad-4ca1-be36-0f5d916f6841 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:42.716329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:42.717010 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:42.724681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:42.724826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-e58a77f8-2bd0-40f0-a57a-4eec1f9c0f1d req-f267238e-40ad-4ca1-be36-0f5d916f6841 service nova] Creating event network-vif-plugged:3488f17c-8711-4a76-babc-e20b6596afc9 for instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 on hv-cinder-85799 Sep 16 03:52:42.724917 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:42.724917 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:42.725212 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:42.725814 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:42.726284 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:42.727528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:42.728471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-e58a77f8-2bd0-40f0-a57a-4eec1f9c0f1d req-f267238e-40ad-4ca1-be36-0f5d916f6841 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034894 Sep 16 03:52:42.729251 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 267/554] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:42.814398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:42.822278 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7f91de6c-e09d-4d55-b2f3-d6f3686aac85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 200 len: 1326 microversion: 2.1 time: 0.110585 Sep 16 03:52:42.822867 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 288/555] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:42 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:42.903895 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:42.904589 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:42.910662 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:42.911176 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:42.911847 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:42.912541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:42.913219 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:42.913642 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:43.059039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:43.067718 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4027fcc8-70e3-4d61-818a-d656f888985f tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1666 microversion: 2.1 time: 0.169156 Sep 16 03:52:43.068213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 268/556] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:42 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1666 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:43.211589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:43.212313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:43.219881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:43.220501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:43.221006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:43.221719 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:43.222172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:43.222595 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:43.358302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:43.366669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ab6d2631-beec-4a44-bc8e-5eeddfa3c0b8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.159041 Sep 16 03:52:43.367459 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 289/557] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:43 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:43.551936 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:43.552754 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:43.559997 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:43.560495 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:43.560933 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:43.563706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:43.563706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:43.563706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:43.704105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:43.711694 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1fd4c8bb-db7c-4ce7-928b-e26fcd172488 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1318 microversion: 2.1 time: 0.163613 Sep 16 03:52:43.712268 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 269/558] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:43 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:43.846570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:43.847250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:43.853738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:43.854379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:43.854870 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:43.855672 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:43.856117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:43.856534 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:43.869782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d HTTP/1.1 Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:52:43.871424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:52:43.872933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '6fee7fbd-189b-4a53-ba78-d66512c7b09d'} Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:52:43.873807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:52:43.875570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:43.877190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:52:43.877190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-71aac785-2569-4bed-907f-1b3cc45ceabf tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 404 len: 111 microversion: 2.1 time: 0.030159 Sep 16 03:52:43.877190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 290/559] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:43 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:52:43.881812 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-83a1524e-93a0-45cb-bde4-0b747e1cfdf2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '.version_select at 0x7fba7c6213a0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:44.053748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-83a1524e-93a0-45cb-bde4-0b747e1cfdf2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869310059" status: 202 len: 0 microversion: 2.1 time: 0.175859 Sep 16 03:52:44.054346 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 270/560] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Sep 16 03:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869310059 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:52:44.391961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:44.392501 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:44.398548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:44.399329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:44.400124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:44.400985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:44.401640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:44.402383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:44.609421 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:44.618454 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-43b57f22-4700-4f23-86c5-fc12e6e7d4e7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.230381 Sep 16 03:52:44.619055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 291/561] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:44 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:44.736010 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:44.736618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:44.743124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:44.743609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:44.744043 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:44.744929 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:44.745755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:44.746204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:44.880458 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:44.888558 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-75837520-4c24-4efa-96b7-f6ac50dcb46d tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1318 microversion: 2.1 time: 0.156981 Sep 16 03:52:44.889309 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 271/562] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:44 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:52:44.980542 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c2602a3-43cb-43b0-9fc2-57ebb99fec24 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: .version_select at 0x7fba7c694940>, body: {"keypair": {"name": "tempest-keypair-688420617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP40mjs5ecuYA3KrIEUliBmbLsB7SgZC+MSD4AGapf8dagYP0lD07aysPwCf36vgrbPSpJEi8ibROhwOgweVjkON/PUtuy/3Hkr89mAV6a7cFpsQIwkAk7d8YLP+Ru8HRw=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:44.996520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-0c2602a3-43cb-43b0-9fc2-57ebb99fec24 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:52:45.000270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-0c2602a3-43cb-43b0-9fc2-57ebb99fec24 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for user ff7df9be8475405eba924b59a7bd6bb0 and project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:52:45.105256 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0c2602a3-43cb-43b0-9fc2-57ebb99fec24 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128612 Sep 16 03:52:45.105842 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 292/563] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:52:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:45.642539 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:45.643223 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:45.649333 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:45.657181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:45.657181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:45.657181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:45.657181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:45.657854 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:45.783828 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:45.792205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6f509267-b7ab-4fc6-af5d-7cf0ac4d4fe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.153514 Sep 16 03:52:45.792785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 272/564] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:45 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:45.911347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:45.911957 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:45.918446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:45.918947 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:45.919387 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:45.920079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:45.920529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:45.920949 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:46.063574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:46.072005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e658552d-6c96-4c9b-b09a-f7db3511127c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1507 microversion: 2.1 time: 0.164273 Sep 16 03:52:46.072371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 293/565] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:45 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:46.098705 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8bdac10-6de1-4fe9-9d37-68249d9558ff", "device": "/dev/sdb"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:46.101750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:46.108747 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:46.109234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:46.109711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:46.110416 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:46.110868 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:46.111323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:46.816461 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:46.817077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:46.823063 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:46.824263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:46.824702 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:46.825525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:46.825979 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:46.826508 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:46.829067 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:46.965450 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:46.973634 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bd098b2d-e9af-4740-beb3-c923925f60e2 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.161026 Sep 16 03:52:46.974200 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 294/566] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:46 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:47.690592 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1425347807", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ff8c520-12d3-47e5-b499-6dbd6e9a131a"}], "security_groups": [{"name": "tempest-securitygroup--406061688"}], "key_name": "tempest-keypair-688420617", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:47.794290 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] validate_networks() for [('4ff8c520-12d3-47e5-b499-6dbd6e9a131a', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:52:47.976912 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1c2c406f-a595-4828-be8b-d5868a8b4998 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "POST /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.881874 Sep 16 03:52:47.978437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 273/567] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:52:46 2022] POST /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2/os-volume_attachments => generated 194 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:48.007707 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:48.008435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:48.014872 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:48.018248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:48.018248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:48.018248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:48.018248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:48.018641 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:48.154636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:48.163151 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-04c6873a-f04e-4d61-a9d1-6992d85fc10b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.166085 Sep 16 03:52:48.163835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 274/568] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:47 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:48.185277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:52:48.185700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:52:48.186176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:52:48.186593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:52:48.187032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:52:48.195727 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:48.196207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:48.196642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:48.197372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:48.197823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:48.198762 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:48.215661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:52:48.219625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for user ff7df9be8475405eba924b59a7bd6bb0 and project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:52:48.221872 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:48.231037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:52:48.233330 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:52:48.332962 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-172403b6-43f7-4c4c-bff2-8626bd45cfbe tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.646696 Sep 16 03:52:48.343620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 295/569] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:52:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 03:52:48.350390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e67a5f16-00b6-4141-bc2f-545a212e7653 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:48.351043 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e67a5f16-00b6-4141-bc2f-545a212e7653 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:48.405102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e67a5f16-00b6-4141-bc2f-545a212e7653 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:48.412123 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e67a5f16-00b6-4141-bc2f-545a212e7653 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1241 microversion: 2.1 time: 0.067626 Sep 16 03:52:48.412707 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 275/570] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:48 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:49.187661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:49.188248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:49.195226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:49.197554 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:49.197554 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:49.197554 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:49.197554 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:49.198038 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:49.337232 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:49.346334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e886db46-13fd-46b2-bbda-47efdcd6ad68 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1733 microversion: 2.1 time: 0.163163 Sep 16 03:52:49.347165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 296/571] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:49 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:49.435827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:49.436529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:49.443480 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:49.443969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:49.444400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:49.445107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:49.445524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:49.445941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:49.508537 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:49.517075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-41b99927-148e-4cdd-be4f-d9f0d6819dd1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1245 microversion: 2.1 time: 0.085353 Sep 16 03:52:49.517647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 276/572] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:49 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:50.371367 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:50.371982 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:50.378488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:50.379002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:50.379443 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:50.380129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:50.380579 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:50.381001 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:50.513191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:50.521490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1b92c367-8068-4734-8b62-13fe7233028a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1713 microversion: 2.1 time: 0.154490 Sep 16 03:52:50.522051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 297/573] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:50 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:50.538722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:50.539416 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:50.546016 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:50.546848 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:50.547386 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:50.548649 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:50.548649 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:50.549022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:50.641043 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:50.641647 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:50.647787 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:50.648350 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:50.648999 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:50.649691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:50.650141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:50.650876 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:50.656190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:50.663821 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3dc19018-84b1-41fa-adfd-f8ae192a3718 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1301 microversion: 2.1 time: 0.128985 Sep 16 03:52:50.679300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 277/574] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:50 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1301 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:50.744131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] HTTP exception thrown: Cannot 'detach_volume' instance aa7bab22-1639-467d-ba7a-94c97e1b9231 while it is in vm_state rescued Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Request method failure captured: Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments/db7fc0d4-321f-44e8-8490-cdb726141bd5 HTTP/1.1 Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IQJXyFJdHaMqBjeHrrX6Vc1xzZgD1ImELyXYJrUZwdAsqBKD1-4JJwShHN6JJiLxATqXwbGbUt4LTiPZxdSHBtKReRq2iPr19u7dHdT0PEwFAbTNlt9KE6AsRMQTcqEFePru42CEaC430wnwaGuQ5QX4fLiSO4iDxqHDBTRWlT8Yg Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:52:50.746358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}] Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: a6b29b9086f64ea7a7990572567642f7 Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:52:50.748082 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Cannot 'detach_volume' instance aa7bab22-1639-467d-ba7a-94c97e1b9231 while it is in vm_state rescued Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'server_id': 'aa7bab22-1639-467d-ba7a-94c97e1b9231', 'id': 'db7fc0d4-321f-44e8-8490-cdb726141bd5'} Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aa7bab22-1639-467d-ba7a-94c97e1b9231 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:52:50.752347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance aa7bab22-1639-467d-ba7a-94c97e1b9231 while it is in vm_state rescued Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance aa7bab22-1639-467d-ba7a-94c97e1b9231 while it is in vm_state rescued Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:52:50.754044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Returning 409 to user: Cannot 'detach_volume' instance aa7bab22-1639-467d-ba7a-94c97e1b9231 while it is in vm_state rescued {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:52:50.755381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cbfd0b38-cec1-40d6-b10b-669b28d95eb9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments/db7fc0d4-321f-44e8-8490-cdb726141bd5" status: 409 len: 152 microversion: 2.1 time: 0.110849 Sep 16 03:52:50.755381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 298/575] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:52:50 2022] DELETE /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments/db7fc0d4-321f-44e8-8490-cdb726141bd5 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 16 03:52:50.758383 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:50.758934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:50.765757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:50.766270 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:50.766678 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:50.767516 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:50.772606 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:50.773083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:50.985318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f15f12b9-e678-4172-ad71-104ec0767355 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "POST /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/action" status: 202 len: 0 microversion: 2.1 time: 0.231575 Sep 16 03:52:50.988850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 278/576] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:52:50 2022] POST /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:52:50.994267 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:50.994875 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:51.001609 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:51.002091 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:51.002516 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:51.003237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:51.003689 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:51.004103 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:51.143800 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:51.153425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-27901ce8-7903-4466-a5ce-b2d4d5d3a3c8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1721 microversion: 2.1 time: 0.163044 Sep 16 03:52:51.155504 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 299/577] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:50 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:51.688526 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:51.689803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:51.696965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:51.697447 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:51.697877 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:51.698786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:51.699632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:51.699632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:51.910481 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:51.920361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7667ad92-ba9b-4c20-bd5d-b8a7846f7658 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.236193 Sep 16 03:52:51.920684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 279/578] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:51 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:52.177875 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:52.189249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:52.189249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:52.189249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:52.189249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:52.189787 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:52.189787 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:52.190073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:52.325478 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:52.333857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a2162621-7060-4523-9769-e7521cb71a7b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1721 microversion: 2.1 time: 0.159810 Sep 16 03:52:52.334786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 300/579] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:52 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:52.657581 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-fbcdc600-95ad-4b14-b6ea-ca82a9727bf2 req-d2a1b8bd-bfa7-4275-88b3-aaadcd2d6997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb6e8c47-3155-423c-ac27-8e71fc56bbce", "tag": "7435ce50-992e-4f86-a4f8-fd731af0e104"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:52.667846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-fbcdc600-95ad-4b14-b6ea-ca82a9727bf2 req-d2a1b8bd-bfa7-4275-88b3-aaadcd2d6997 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:52.668332 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-fbcdc600-95ad-4b14-b6ea-ca82a9727bf2 req-d2a1b8bd-bfa7-4275-88b3-aaadcd2d6997 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:52.668753 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-fbcdc600-95ad-4b14-b6ea-ca82a9727bf2 req-d2a1b8bd-bfa7-4275-88b3-aaadcd2d6997 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:52.679934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-fbcdc600-95ad-4b14-b6ea-ca82a9727bf2 req-d2a1b8bd-bfa7-4275-88b3-aaadcd2d6997 service nova] Creating event network-changed:7435ce50-992e-4f86-a4f8-fd731af0e104 for instance bb6e8c47-3155-423c-ac27-8e71fc56bbce on hv-cinder-85799 Sep 16 03:52:52.685214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-fbcdc600-95ad-4b14-b6ea-ca82a9727bf2 req-d2a1b8bd-bfa7-4275-88b3-aaadcd2d6997 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031745 Sep 16 03:52:52.685804 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 280/580] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:52.944428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:52.945042 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:52.951935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:52.952413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:52.952845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:52.953530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:52.953981 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:52.954397 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.084586 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:53.092131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fe4021bf-d6c7-4736-80f8-a56c5c7ef408 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.151580 Sep 16 03:52:53.092688 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 301/581] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:52 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:53.368237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:53.368237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:53.370498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:53.371045 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:53.371569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.372262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:53.372858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:53.373285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.373448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:53.373899 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:53.376264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:53.381372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:53.381941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:53.382378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.383116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:53.383563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:53.383983 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.418138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3595040f-0f1d-4747-83ba-01ab5a1e0ba4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments/c7691292-e766-4b1c-b523-d883e7410a19" status: 200 len: 194 microversion: 2.20 time: 0.049297 Sep 16 03:52:53.418718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 302/582] 10.222.0.49 () {60 vars in 1454 bytes} [Fri Sep 16 03:52:53 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments/c7691292-e766-4b1c-b523-d883e7410a19 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:52:53.492417 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:53.492912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:53.499572 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:53.500058 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:53.500493 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.501184 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:53.501630 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:53.502050 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.561396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:53.584899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-237e0fe1-dba0-4972-90e0-7eae84f6e2fe tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1721 microversion: 2.1 time: 0.226886 Sep 16 03:52:53.585487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 281/583] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:53 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:53.592368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lazy-loading 'services' on Instance uuid 230b59e9-09d0-4448-a6a6-a395823fcd8b {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:52:53.857827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3b5c4d5d-fdd1-4850-8fb5-b6f33c5263aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments/c7691292-e766-4b1c-b523-d883e7410a19" status: 202 len: 0 microversion: 2.20 time: 0.369162 Sep 16 03:52:53.858405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 303/584] 10.222.0.49 () {60 vars in 1457 bytes} [Fri Sep 16 03:52:53 2022] DELETE /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments/c7691292-e766-4b1c-b523-d883e7410a19 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 03:52:53.866614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:53.868749 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:53.875161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:53.875643 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:53.876075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.876759 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:53.877206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:53.877627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:53.907489 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-377c7ce4-d1b0-43e2-a088-e056e47f549f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044650 Sep 16 03:52:53.908006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 282/585] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 16 03:52:53 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:52:54.115495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:54.116118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:54.122561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:54.123202 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:54.123767 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:54.124470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:54.124917 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:54.125371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:54.269145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:54.277346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d8c2ce68-fa65-4d66-82d6-cd1ab411e58b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.165709 Sep 16 03:52:54.278308 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 304/586] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:54 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:54.609461 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:54.610072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:54.616538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:54.616964 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:54.617398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:54.618083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:54.618535 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:54.618988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:54.749401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:54.757604 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-30252b3b-5f5e-400c-a86c-9fb975387b52 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1727 microversion: 2.1 time: 0.152967 Sep 16 03:52:54.758160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 283/587] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:54 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:54.780502 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:54.781031 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:54.787461 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:54.787952 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:54.788390 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:54.792705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:54.792705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:54.792705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:54.876318 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c46820d6-08a3-4ce3-ae97-fd0301eab92d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099200 Sep 16 03:52:54.876930 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 305/588] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 16 03:52:54 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:54.921070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:54.923359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:54.929467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:54.929950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:54.930842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:54.931720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:54.932322 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:54.933056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:54.966740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0d0faac2-2af8-4b11-9e31-7c643e9d9f19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049874 Sep 16 03:52:54.967568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 284/589] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 16 03:52:54 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:52:55.300609 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:55.301492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:55.308916 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:55.309623 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:55.310228 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:55.310974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:55.311433 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:55.311997 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:55.507462 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:55.515699 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3807b63e-6d4b-41f5-834f-b09fe27390e6 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.218999 Sep 16 03:52:55.516258 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 306/590] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:55 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:55.889449 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0cfe8aa6-3e06-40e2-acba-2e304591931d req-dd1a4fce-9771-4c4d-b474-33ff609fd470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7bab22-1639-467d-ba7a-94c97e1b9231", "tag": "552dfee7-ff27-4901-a9cb-8d274e8becd6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:55.899253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0cfe8aa6-3e06-40e2-acba-2e304591931d req-dd1a4fce-9771-4c4d-b474-33ff609fd470 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:55.899949 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0cfe8aa6-3e06-40e2-acba-2e304591931d req-dd1a4fce-9771-4c4d-b474-33ff609fd470 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:55.900692 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0cfe8aa6-3e06-40e2-acba-2e304591931d req-dd1a4fce-9771-4c4d-b474-33ff609fd470 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:55.913377 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0cfe8aa6-3e06-40e2-acba-2e304591931d req-dd1a4fce-9771-4c4d-b474-33ff609fd470 service nova] Creating event network-changed:552dfee7-ff27-4901-a9cb-8d274e8becd6 for instance aa7bab22-1639-467d-ba7a-94c97e1b9231 on hv-cinder-85799 Sep 16 03:52:55.917532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0cfe8aa6-3e06-40e2-acba-2e304591931d req-dd1a4fce-9771-4c4d-b474-33ff609fd470 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Sep 16 03:52:55.918132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 285/591] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:52:55.979885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:55.982257 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:55.988712 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:55.989183 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:55.989608 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:55.990343 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:55.990755 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:55.991195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:56.021640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c9e16002-4437-4e4f-82c3-bd55dff11a28 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045897 Sep 16 03:52:56.022198 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 307/592] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 16 03:52:55 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:52:56.542401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:56.543346 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:56.560578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:56.560578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:56.560578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:56.560578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:56.562275 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:56.562275 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:56.791439 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:56.799862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0a33d2d6-396b-4c62-8d90-dbd52115920a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.264563 Sep 16 03:52:56.800464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 286/593] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:56 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:57.034148 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:57.036317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:57.043811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:57.044295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:57.046371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:57.046371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:57.046371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:57.046371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:57.075803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a0f4bdaf-7d97-4a45-8329-784f0ce35ef7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045604 Sep 16 03:52:57.076357 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 308/594] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 16 03:52:57 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:52:57.822158 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:57.822820 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:57.829379 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:57.829867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:57.830302 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:57.831032 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:57.831479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:57.831898 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:57.933458 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-3dc1d7e0-b234-4129-b3fd-2a4b994e955d req-5e3aac34-43cd-40f4-b2bc-0d22b60cf743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7bab22-1639-467d-ba7a-94c97e1b9231", "tag": "552dfee7-ff27-4901-a9cb-8d274e8becd6"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:52:57.943416 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3dc1d7e0-b234-4129-b3fd-2a4b994e955d req-5e3aac34-43cd-40f4-b2bc-0d22b60cf743 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:57.943893 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3dc1d7e0-b234-4129-b3fd-2a4b994e955d req-5e3aac34-43cd-40f4-b2bc-0d22b60cf743 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:57.944315 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3dc1d7e0-b234-4129-b3fd-2a4b994e955d req-5e3aac34-43cd-40f4-b2bc-0d22b60cf743 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:57.956511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-3dc1d7e0-b234-4129-b3fd-2a4b994e955d req-5e3aac34-43cd-40f4-b2bc-0d22b60cf743 service nova] Creating event network-changed:552dfee7-ff27-4901-a9cb-8d274e8becd6 for instance aa7bab22-1639-467d-ba7a-94c97e1b9231 on hv-cinder-85799 Sep 16 03:52:57.961849 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-3dc1d7e0-b234-4129-b3fd-2a4b994e955d req-5e3aac34-43cd-40f4-b2bc-0d22b60cf743 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033687 Sep 16 03:52:57.962843 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 309/595] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:52:57.969712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:57.978533 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f5d06f2c-7935-40ab-96b1-1729f01cd0ac tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.160221 Sep 16 03:52:57.979126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 287/596] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:57 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:58.088547 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:58.100724 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:58.117195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:58.117763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:58.118249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:58.118845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:58.119320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:58.119741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:58.157769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-07576eee-c3c3-4f93-b308-f0809776022b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.073396 Sep 16 03:52:58.158549 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 310/597] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 16 03:52:58 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:58.227130 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:58.227660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:58.233754 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:58.234235 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:58.239761 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:58.239761 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:58.239761 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:58.239761 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:58.263067 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:52:58.409850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:58.600479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-201ccf39-c477-4c6d-a7b5-6905be26efc4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 204 len: 0 microversion: 2.20 time: 0.377290 Sep 16 03:52:58.601098 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 288/598] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Sep 16 03:52:58 2022] DELETE /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 03:52:58.617750 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:58.618352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:58.620289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:58.620945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=10 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:58.626338 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:58.626812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:58.627283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:58.627958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:58.628401 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:58.628841 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:58.762929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:58.765159 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:58.772582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:58.777416 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:58.777416 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b7fb0792-048e-4281-a183-5449f3b191f5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.161276 Sep 16 03:52:58.777416 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 311/599] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:58 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:52:59.008136 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:59.008761 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:59.015733 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:59.016044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:59.016477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:59.017153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:59.017598 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:59.018013 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:59.152117 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:59.160560 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-40663acc-58e8-465f-9a85-0eed531180da tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.156805 Sep 16 03:52:59.161135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 289/600] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:52:59 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:52:59.801896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:52:59.802505 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:52:59.811717 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:59.812191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:59.812620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:59.813300 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:52:59.813745 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:52:59.814164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:52:59.939515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:59.947450 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:59.948896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:52:59.950033 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f88fd576-be35-41a4-be8d-8b9183d36f05 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.152106 Sep 16 03:52:59.950623 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 312/601] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:52:59 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:00.185010 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:00.187607 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:00.195907 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:00.196394 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:00.196832 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:00.197643 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:00.198109 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:00.198532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:00.327728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:00.335406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c9c35277-1d93-4665-b71b-c245f92e284a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.154362 Sep 16 03:53:00.335970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 290/602] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:00 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:00.974852 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:00.975490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:00.982437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:00.982934 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:00.983405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:00.984090 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:00.984537 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:00.984957 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:01.111213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:01.119186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:01.120616 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:01.121760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0d6665c6-b390-4d32-b289-3aff6e3e7bab tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.150773 Sep 16 03:53:01.123012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 313/603] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:00 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:01.358053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:01.358693 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:01.365295 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:01.365775 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:01.366208 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:01.366887 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:01.367388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:01.367810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:01.511282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:01.519657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-56af7377-c133-4d06-991a-b4a9d25b5822 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.165946 Sep 16 03:53:01.520216 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 291/604] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:01 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:02.148582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:02.149190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:02.156108 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:02.156584 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:02.157016 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:02.157732 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:02.158175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:02.158595 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:02.298411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:02.307068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:02.308690 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:02.309933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6e9690ed-f20f-4d70-b1c1-66d9b8eab862 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.165315 Sep 16 03:53:02.311003 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 314/605] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:02 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:02.543252 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:02.544395 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:02.551409 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:02.551890 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:02.552461 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:02.553036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:02.553480 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:02.553893 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:02.684622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:02.693172 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a248e7bd-0d39-4874-8873-c9e2a5a26e70 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.155188 Sep 16 03:53:02.693804 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 292/606] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:02 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:03.336062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:03.336671 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:03.343691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:03.344174 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:03.344609 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:03.345293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:03.345741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:03.346167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:03.480271 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:03.489678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:03.491143 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:03.492290 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6f5ba3f8-354d-4ca9-9fec-2f0234fb9026 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.160155 Sep 16 03:53:03.492845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 315/607] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:03 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:03.717747 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:03.718362 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:03.724891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:03.725376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:03.725814 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:03.726504 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:03.726984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:03.727402 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:03.877827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:03.885369 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f6f6136-86b9-483b-8236-735b1cdd728b tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.172101 Sep 16 03:53:03.885931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 293/608] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:03 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:04.518306 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:04.518950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:04.525522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:04.526006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:04.526442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:04.527162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:04.527614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:04.528039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:04.659072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:04.667172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:04.670203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:04.670203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-66e4e1a7-fce8-47fb-b0d8-f1c648ee451a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.155566 Sep 16 03:53:04.670401 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 316/609] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:04 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:04.908414 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:04.909053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:04.915490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:04.916010 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:04.916444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:04.917131 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:04.917581 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:04.918007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:05.051956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:05.060235 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1efe6412-d5c6-4792-8838-6eaeadfce2e5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.156221 Sep 16 03:53:05.061166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 294/610] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:04 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:05.225803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-97dcc6b9-303a-410b-99e7-f2b31936f3a7 req-8c7cca3f-e9fd-4e53-ade4-17e2edc9df12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6e8c47-3155-423c-ac27-8e71fc56bbce", "name": "network-vif-plugged", "status": "completed", "tag": "7435ce50-992e-4f86-a4f8-fd731af0e104"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:05.235394 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-97dcc6b9-303a-410b-99e7-f2b31936f3a7 req-8c7cca3f-e9fd-4e53-ade4-17e2edc9df12 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:05.235863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-97dcc6b9-303a-410b-99e7-f2b31936f3a7 req-8c7cca3f-e9fd-4e53-ade4-17e2edc9df12 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:05.236290 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-97dcc6b9-303a-410b-99e7-f2b31936f3a7 req-8c7cca3f-e9fd-4e53-ade4-17e2edc9df12 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:05.246831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-97dcc6b9-303a-410b-99e7-f2b31936f3a7 req-8c7cca3f-e9fd-4e53-ade4-17e2edc9df12 service nova] Creating event network-vif-plugged:7435ce50-992e-4f86-a4f8-fd731af0e104 for instance bb6e8c47-3155-423c-ac27-8e71fc56bbce on hv-cinder-85799 Sep 16 03:53:05.252833 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-97dcc6b9-303a-410b-99e7-f2b31936f3a7 req-8c7cca3f-e9fd-4e53-ade4-17e2edc9df12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030690 Sep 16 03:53:05.253427 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 317/611] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:05.696971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:05.697574 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:05.704383 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:05.704859 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:05.705291 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:05.705965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:05.706412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:05.706829 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:05.836637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:05.844568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:05.846006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:05.847168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1521810e-aa68-4255-95ef-9cae8423dd17 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1722 microversion: 2.20 time: 0.154243 Sep 16 03:53:05.847714 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 295/612] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:05 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:06.084004 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:06.084837 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:06.091345 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:06.092110 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:06.092688 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:06.093631 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:06.094215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:06.094681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:06.280793 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:06.289059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1869d503-1784-4e00-8c9b-95c3665c8d2f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.210162 Sep 16 03:53:06.289686 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 318/613] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:06 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:06.798440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-2002e1a1-f93a-44eb-ad74-03a92550ec60 req-0c5f3e24-6bc8-4bf8-a946-2b7d4f2d3834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230b59e9-09d0-4448-a6a6-a395823fcd8b", "name": "network-vif-deleted", "tag": "a04cc8c1-86e6-4381-8e36-de59ce5d9321"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:06.808671 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2002e1a1-f93a-44eb-ad74-03a92550ec60 req-0c5f3e24-6bc8-4bf8-a946-2b7d4f2d3834 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:06.809142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2002e1a1-f93a-44eb-ad74-03a92550ec60 req-0c5f3e24-6bc8-4bf8-a946-2b7d4f2d3834 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:06.810092 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2002e1a1-f93a-44eb-ad74-03a92550ec60 req-0c5f3e24-6bc8-4bf8-a946-2b7d4f2d3834 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:06.822999 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-2002e1a1-f93a-44eb-ad74-03a92550ec60 req-0c5f3e24-6bc8-4bf8-a946-2b7d4f2d3834 service nova] Creating event network-vif-deleted:a04cc8c1-86e6-4381-8e36-de59ce5d9321 for instance 230b59e9-09d0-4448-a6a6-a395823fcd8b on hv-cinder-85799 Sep 16 03:53:06.828488 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-2002e1a1-f93a-44eb-ad74-03a92550ec60 req-0c5f3e24-6bc8-4bf8-a946-2b7d4f2d3834 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034114 Sep 16 03:53:06.829225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 296/614] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:06.871979 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:06.872681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:06.881289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:06.881784 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:06.882217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:06.882942 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:06.883388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:06.883803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:06.962519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:06.972025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:06.973642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:06.974872 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-834f7380-49a3-4841-b1c8-cde11cb6f643 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1654 microversion: 2.20 time: 0.106783 Sep 16 03:53:06.976119 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 319/615] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:06 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1654 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:07.315004 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:07.315625 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:07.322569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:07.323377 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:07.323963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:07.325024 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:07.325482 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:07.325908 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:07.345558 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:07.467360 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:07.475487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-45680630-2af4-449d-b2e5-9db85ad470c4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1366 microversion: 2.1 time: 0.165802 Sep 16 03:53:07.478426 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 297/616] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:07 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:08.001572 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:08.002178 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:08.008796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:08.009270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:08.009706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:08.010404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:08.010853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:08.011302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:08.042377 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:08.042852 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:08.043366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:08.043758 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lazy-loading 'fault' on Instance uuid 230b59e9-09d0-4448-a6a6-a395823fcd8b {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:08.085769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:08.100817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:08.100817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:08.103282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-93a6ddf2-8cb4-47dd-873e-4a07855bf803 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 200 len: 1370 microversion: 2.20 time: 0.103720 Sep 16 03:53:08.103282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 320/617] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:07 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:08.498326 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:08.498966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:08.506259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:08.506740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:08.507202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:08.508915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:08.508915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:08.508915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:08.640220 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:08.648349 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b2647cce-55f4-44e9-8cc2-ddfd77432281 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1556 microversion: 2.1 time: 0.153838 Sep 16 03:53:08.648903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 298/618] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:08 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:08.670492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:08.671085 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:08.677375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:08.677866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:08.678305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:08.684573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:08.684573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:08.684573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:08.759964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-66c0e6be-5cf5-49a1-b0f2-95fb0f818954 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093575 Sep 16 03:53:08.760566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 321/619] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 16 03:53:08 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:09.137811 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:09.138428 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:09.146509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:09.147026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:09.147461 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:09.148160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:09.148609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:09.149030 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:09.164539 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] HTTP exception thrown: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Request method failure captured: Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b HTTP/1.1 Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_INlXgauEO6bUP-GJLsPv1cPbNKSOTbGOP8XYGB4h5SHFL1AwIMChoUNrykJc4TDPoqZ-uFOLU8mg0d95oc_qrYpErkRfVmDEXXQSJdGUgmh9Q8Vu1dr3gR2hIIsc39BziuBtYBK8I9dtpGsqR6pe8ZysuqFylTjRMfZmKBPTiVFpo Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:53:09.166226 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb698ddcedae42a29f50203ec59db295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}] Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 416479ba056f4612b6214cf115251269 Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:53:09.167981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '230b59e9-09d0-4448-a6a6-a395823fcd8b'} Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:53:09.168971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:53:09.170376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:09.177105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Returning 404 to user: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:53:09.177105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a53a1f07-25a9-4a9c-8e30-495328de6d41 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 404 len: 111 microversion: 2.20 time: 0.034233 Sep 16 03:53:09.177105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 299/620] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:09 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:53:09.178509 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b64732cc-6d3e-428f-8c8e-28f56bad0773 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '.version_select at 0x7fba7c5fbca0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:09.355604 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b64732cc-6d3e-428f-8c8e-28f56bad0773 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229780924" status: 204 len: 0 microversion: 2.20 time: 0.181902 Sep 16 03:53:09.356505 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 322/621] 10.222.0.49 () {60 vars in 1259 bytes} [Fri Sep 16 03:53:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229780924 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 03:53:10.081573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-7392e018-839d-48f2-9522-0c7ed458b48a req-b92ab189-0ca4-4ea1-bbfa-3999be119116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb6e8c47-3155-423c-ac27-8e71fc56bbce", "tag": "7435ce50-992e-4f86-a4f8-fd731af0e104"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:10.092172 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7392e018-839d-48f2-9522-0c7ed458b48a req-b92ab189-0ca4-4ea1-bbfa-3999be119116 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:10.092564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7392e018-839d-48f2-9522-0c7ed458b48a req-b92ab189-0ca4-4ea1-bbfa-3999be119116 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:10.092986 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7392e018-839d-48f2-9522-0c7ed458b48a req-b92ab189-0ca4-4ea1-bbfa-3999be119116 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:10.106194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-7392e018-839d-48f2-9522-0c7ed458b48a req-b92ab189-0ca4-4ea1-bbfa-3999be119116 service nova] Creating event network-changed:7435ce50-992e-4f86-a4f8-fd731af0e104 for instance bb6e8c47-3155-423c-ac27-8e71fc56bbce on hv-cinder-85799 Sep 16 03:53:10.112228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-7392e018-839d-48f2-9522-0c7ed458b48a req-b92ab189-0ca4-4ea1-bbfa-3999be119116 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034810 Sep 16 03:53:10.113095 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 300/622] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:10.556472 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:10.557797 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:10.566047 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:10.566745 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:10.567425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:10.567894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:10.568347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:10.568759 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:10.594470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-68998574-2e2a-4640-bb92-4b4bad7d1444 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'create', calling method: .version_select at 0x7fba7c621280>, body: {"keypair": {"name": "tempest-keypair-2038194499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRSGPf6IBoo5xHKQzxKO4yGuTbywNlTJ3OPA2mhdvCeJDfBJ8Ue3obdgZodG2fTMCgPunDeTr1DH94Co7WIKa+RtORyR/8baSQCOT3UXSvgazOvtJuh8UAXGVRoBcstrw=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:10.624803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-68998574-2e2a-4640-bb92-4b4bad7d1444 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Getting quotas for project cb698ddcedae42a29f50203ec59db295. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:53:10.624803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-68998574-2e2a-4640-bb92-4b4bad7d1444 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Getting quotas for user 416479ba056f4612b6214cf115251269 and project cb698ddcedae42a29f50203ec59db295. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:53:10.667605 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lazy-loading 'services' on Instance uuid 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:10.756026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-68998574-2e2a-4640-bb92-4b4bad7d1444 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.166793 Sep 16 03:53:10.763040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 301/623] 10.222.0.49 () {62 vars in 1200 bytes} [Fri Sep 16 03:53:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 16 03:53:10.933956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0ea4036a-1589-4d00-ab70-87f6c1a698cb tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2/os-volume_attachments/f8bdac10-6de1-4fe9-9d37-68249d9558ff" status: 202 len: 0 microversion: 2.1 time: 0.389522 Sep 16 03:53:10.934553 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 323/624] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:53:10 2022] DELETE /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2/os-volume_attachments/f8bdac10-6de1-4fe9-9d37-68249d9558ff => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:53:11.404849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:11.405421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:11.412238 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:11.412712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:11.413143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:11.413819 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:11.414264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:11.414679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:11.437282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lazy-loading 'flavor' on Instance uuid 1d52b03d-e8ff-4942-a9d3-33b7341dad63 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:11.849763 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f4e60736-a687-4d05-a98e-0c12852bf07b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "POST /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63/action" status: 202 len: 0 microversion: 2.1 time: 0.449260 Sep 16 03:53:11.850328 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 302/625] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:53:11 2022] POST /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:53:11.859831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:11.860573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:11.866929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:11.867425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:11.867864 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:11.868561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:11.869043 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:11.869465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:12.252003 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:12.259815 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0fb9c49a-bc97-428b-b9f2-a04872239fd9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.404825 Sep 16 03:53:12.260384 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 324/626] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:11 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:13.129815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:13.130394 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:13.133303 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:13.138829 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:13.139396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:13.139835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:13.140580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:13.141730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:13.142298 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:13.169300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:53:13.283964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:13.284604 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:13.291079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:13.291563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:13.291996 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:13.292688 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:13.293134 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:13.293555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:13.427930 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:13.435829 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0cfe03fb-d8c1-4bd3-a985-8beb2f23c470 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.156301 Sep 16 03:53:13.436385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 325/627] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:13 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:13.443077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-747870312", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60a25330-2068-4171-85ea-2cd82f09cbdb"}], "security_groups": [{"name": "tempest-securitygroup--649777982"}], "key_name": "tempest-keypair-2038194499", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:13.530228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2a17d304-e348-4a77-a019-3c08163bc73e tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 204 len: 0 microversion: 2.1 time: 0.406271 Sep 16 03:53:13.530933 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 303/628] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:53:13 2022] DELETE /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:53:13.540410 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:13.541240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:13.547470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:13.548013 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:13.550153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:13.550153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:13.550153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:13.550153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:13.558169 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] validate_networks() for [('60a25330-2068-4171-85ea-2cd82f09cbdb', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:53:13.683580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:13.691519 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-49971286-6618-4124-9a0a-0b28112578dc tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1513 microversion: 2.1 time: 0.155132 Sep 16 03:53:13.692275 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 304/629] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:13 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:13.930968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:53:13.931445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:53:13.931937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:53:13.932280 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:53:13.932691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:53:13.942328 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:13.951391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:13.951391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:13.951391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:13.951391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:13.951741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:13.961928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Getting quotas for project cb698ddcedae42a29f50203ec59db295. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:53:13.965978 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Getting quotas for user 416479ba056f4612b6214cf115251269 and project cb698ddcedae42a29f50203ec59db295. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:53:13.977489 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:53:13.980242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:53:14.145989 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-13abeac4-495a-48dc-a709-17c72f4aa5aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.708562 Sep 16 03:53:14.146622 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 326/630] 10.222.0.49 () {62 vars in 1188 bytes} [Fri Sep 16 03:53:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 03:53:14.158054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-88dd4d34-6b9e-4e5a-95b3-fec7dad96cf9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:14.158662 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-88dd4d34-6b9e-4e5a-95b3-fec7dad96cf9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:14.271905 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-88dd4d34-6b9e-4e5a-95b3-fec7dad96cf9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:14.279255 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-88dd4d34-6b9e-4e5a-95b3-fec7dad96cf9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:14.280706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-88dd4d34-6b9e-4e5a-95b3-fec7dad96cf9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:14.281858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-88dd4d34-6b9e-4e5a-95b3-fec7dad96cf9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1281 microversion: 2.20 time: 0.128010 Sep 16 03:53:14.282419 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 305/631] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:14 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:14.459678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:14.460418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:14.469065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:14.469704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:14.470030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:14.470739 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:14.471192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:14.471612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:14.606117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:14.613736 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1a78f3e7-d217-4669-89df-cba20ff12ca7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.158347 Sep 16 03:53:14.614292 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 327/632] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:14 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:14.714703 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:14.715492 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:14.722842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:14.723433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:14.723870 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:14.724558 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:14.725007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:14.725431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:14.868314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:14.876220 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-88b559f3-17cc-4a61-9870-6b1183742c2c tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1513 microversion: 2.1 time: 0.165298 Sep 16 03:53:14.876789 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 306/633] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:14 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:15.306626 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:15.307192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:15.313458 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:15.313952 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:15.314385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:15.315119 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:15.315578 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:15.317290 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:15.379347 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:15.387822 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:15.389336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:15.390458 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-10835403-c188-4a8a-a197-35c0d38384a6 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1285 microversion: 2.20 time: 0.088246 Sep 16 03:53:15.391676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 328/634] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:15 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:15.637237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:15.637850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:15.644849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:15.645338 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:15.645776 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:15.646464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:15.646933 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:15.647366 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:15.823932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:15.833236 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ed925073-3f04-4d70-9012-133d74edd681 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.199005 Sep 16 03:53:15.834003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 307/635] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:15 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:15.899192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:15.899748 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:15.906251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:15.907339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:15.907780 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:15.908487 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:15.908936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:15.909359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:16.051924 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:16.060665 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-55d004d1-75ff-4f13-b762-01b7599b85db tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1513 microversion: 2.1 time: 0.165468 Sep 16 03:53:16.061307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 329/636] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:15 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:16.395858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-71754c98-392a-4438-a43c-4835fe672836 req-65fce11d-78f6-42d4-8736-ac5cc6faec04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e433d47-53b8-4ba1-b28d-ad599d89bbf2", "name": "network-vif-deleted", "tag": "3488f17c-8711-4a76-babc-e20b6596afc9"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:16.405164 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-71754c98-392a-4438-a43c-4835fe672836 req-65fce11d-78f6-42d4-8736-ac5cc6faec04 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:16.405636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-71754c98-392a-4438-a43c-4835fe672836 req-65fce11d-78f6-42d4-8736-ac5cc6faec04 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:16.406060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-71754c98-392a-4438-a43c-4835fe672836 req-65fce11d-78f6-42d4-8736-ac5cc6faec04 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:16.416456 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:16.417093 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:16.417878 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-71754c98-392a-4438-a43c-4835fe672836 req-65fce11d-78f6-42d4-8736-ac5cc6faec04 service nova] Creating event network-vif-deleted:3488f17c-8711-4a76-babc-e20b6596afc9 for instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 on hv-cinder-85799 Sep 16 03:53:16.423674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-71754c98-392a-4438-a43c-4835fe672836 req-65fce11d-78f6-42d4-8736-ac5cc6faec04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031408 Sep 16 03:53:16.423845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:16.424467 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 308/637] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:16.424607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:16.424876 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:16.425650 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:16.426110 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:16.426540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:16.429413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:16.489929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:16.498768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:16.500448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:16.501798 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9a8999f7-6dfd-4b5b-a6a4-bb3babc7e65a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1333 microversion: 2.20 time: 0.089322 Sep 16 03:53:16.502355 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 330/638] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:16 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:53:16.858500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:16.859231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:16.866165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:16.866946 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:16.867385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:16.868267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:16.868718 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:16.869276 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:17.085162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:17.086039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:17.092958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:17.094464 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:17.095186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:17.096281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:17.096717 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:17.097204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:17.110298 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:17.121448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-69c592ae-3f14-47f6-94c4-22d6f0c0c21c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.267641 Sep 16 03:53:17.122014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 309/639] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:16 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:17.129423 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:17.133100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:17.133576 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:17.134002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:17.134888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lazy-loading 'fault' on Instance uuid 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:17.176230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5691b0a2de144779b3b9a276f4f9aa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea684aa585e4b4483261a014d861cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:17.184118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-51a07044-6e16-4b12-a1fe-b5214b855b35 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 200 len: 1308 microversion: 2.1 time: 0.104071 Sep 16 03:53:17.184754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 331/640] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:17 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:17.527731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:17.528332 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:17.535179 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:17.535737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:17.536160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:17.536839 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:17.537281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:17.537702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:17.772487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:17.781086 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:17.783647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:17.784797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10dcdda8-f970-443e-a80c-30f4f48af452 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.261244 Sep 16 03:53:17.785353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 310/641] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:17 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:18.145772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:18.146413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:18.153649 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:18.154130 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:18.154560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:18.155294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:18.155736 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:18.156151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:18.214059 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:18.214763 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] [instance: 1e433d47-53b8-4ba1-b28d-ad599d89bbf2] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:18.221490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:18.221973 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:18.222406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:18.223121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:18.223572 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:18.223992 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:18.238637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] HTTP exception thrown: Instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 could not be found. Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Request method failure captured: Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 HTTP/1.1 Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_KWCxiAZpqMCtUVHWdNqLis39A2ud0GgDOuwqdkBsLiWJiI9hW6RT95HEjbpxoLndlcVrIjbac6Yaybn8p3O408JA9S_NW8K-5SWQB_7b78PuYxz4FT8JW1x8ODip8zMA3aUBiSitX2ou5EFku7sYUvkWQ7nsUqEDEPN6eLOWkE8Lk Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 0ea684aa585e4b4483261a014d861cb1 Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotTestJSON-246206017 Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:53:18.240385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ea684aa585e4b4483261a014d861cb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0ea684aa585e4b4483261a014d861cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0ea684aa585e4b4483261a014d861cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ea684aa585e4b4483261a014d861cb1"}]}] Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotTestJSON-246206017 Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 0ea684aa585e4b4483261a014d861cb1 Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-246206017 Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotTestJSON-246206017-project Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5691b0a2de144779b3b9a276f4f9aa79 Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotTestJSON-246206017-project Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 could not be found. Sep 16 03:53:18.242137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '1e433d47-53b8-4ba1-b28d-ad599d89bbf2'} Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 could not be found. Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:53:18.242956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 could not be found. Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 could not be found. Sep 16 03:53:18.244262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:18.255978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] Returning 404 to user: Instance 1e433d47-53b8-4ba1-b28d-ad599d89bbf2 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:53:18.255978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c1652d13-52a6-477b-a988-80a5f65eb422 tempest-VolumesSnapshotTestJSON-246206017 tempest-VolumesSnapshotTestJSON-246206017-project] 10.222.0.49 "GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2" status: 404 len: 111 microversion: 2.1 time: 0.031670 Sep 16 03:53:18.255978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 311/642] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:18 2022] GET /compute/v2.1/servers/1e433d47-53b8-4ba1-b28d-ad599d89bbf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:53:18.293237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:18.302317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ae55454b-46a7-43c3-8061-7902f27c5731 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.161023 Sep 16 03:53:18.311086 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 332/643] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:18 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:18.685350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-04953aa9-46a9-4e8f-91be-17a2c3dc4b5a req-a4307ee0-5615-440b-8b65-cad608c602e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2263def2-54ff-4255-a751-2bdb7e32db67", "tag": "68bc6748-c4d5-4935-8d58-9b9bd27239ad"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:18.695886 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-04953aa9-46a9-4e8f-91be-17a2c3dc4b5a req-a4307ee0-5615-440b-8b65-cad608c602e9 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:18.696364 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-04953aa9-46a9-4e8f-91be-17a2c3dc4b5a req-a4307ee0-5615-440b-8b65-cad608c602e9 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:18.696790 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-04953aa9-46a9-4e8f-91be-17a2c3dc4b5a req-a4307ee0-5615-440b-8b65-cad608c602e9 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:18.708253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-04953aa9-46a9-4e8f-91be-17a2c3dc4b5a req-a4307ee0-5615-440b-8b65-cad608c602e9 service nova] Creating event network-changed:68bc6748-c4d5-4935-8d58-9b9bd27239ad for instance 2263def2-54ff-4255-a751-2bdb7e32db67 on hv-cinder-85799 Sep 16 03:53:18.712907 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-04953aa9-46a9-4e8f-91be-17a2c3dc4b5a req-a4307ee0-5615-440b-8b65-cad608c602e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032426 Sep 16 03:53:18.713542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 312/644] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:18.813170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:18.813170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:18.819393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:18.819874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:18.820302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:18.820991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:18.821434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:18.821850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:18.959534 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:18.969526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:18.972618 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:18.974005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f6c57257-e2a6-4565-a833-fd1ced27ee34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.166970 Sep 16 03:53:18.974566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 333/645] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:18 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:19.332243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:19.332955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:19.339158 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:19.339638 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:19.340224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:19.340915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:19.341360 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:19.341775 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:19.530026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:19.533814 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-269633f9-77ae-42b7-a10a-194450855121 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.209847 Sep 16 03:53:19.534363 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 313/646] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:19 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:20.000089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:20.000717 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:20.007816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:20.008305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:20.008742 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:20.009485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:20.009970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:20.010399 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:20.137288 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:20.145476 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:20.146946 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:20.148052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b9854756-40e0-4f4a-9fa7-2a351e51b433 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.151971 Sep 16 03:53:20.148611 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 334/647] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:19 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:53:20.557389 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:20.557992 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:20.564841 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:20.565318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:20.565741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:20.566437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:20.566875 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:20.567302 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:20.696478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:20.704609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-170f40ba-2fd2-4e42-9b0c-66b9341f4725 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.151324 Sep 16 03:53:20.705206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 314/648] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:20 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:21.173954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:21.174595 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:21.181292 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:21.181768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:21.182268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:21.182987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:21.183440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:21.183939 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:21.316120 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:21.324442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:21.326036 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:21.327167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9299ccf9-9b98-4a08-9658-917f81184fa8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.157650 Sep 16 03:53:21.327714 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 335/649] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:21 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:21.728062 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:21.728648 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:21.735792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:21.736266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:21.736694 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:21.737367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:21.737813 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:21.738230 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:21.866486 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:21.868824 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:21.874815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ec4b38e7-ebd3-4ae9-b7a0-54cd8b8d7c96 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.150704 Sep 16 03:53:21.875562 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 315/650] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:21 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:22.352274 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:22.352906 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:22.359303 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:22.359814 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:22.360379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:22.361378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:22.361600 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:22.362240 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:22.493463 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:22.502207 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:22.503667 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:22.504749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0243c93f-0aef-4bc8-9dc2-84f4d671de4f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.156333 Sep 16 03:53:22.505303 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 336/651] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:22 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:22.910678 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:22.911435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:22.918117 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:22.918592 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:22.919054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:22.919727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:22.920172 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:22.920585 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:23.048106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:23.055951 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1477114b-6113-4c2c-86ec-1d7d36f97d34 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.149207 Sep 16 03:53:23.056591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 316/652] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:22 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:23.529602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:23.530213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:23.536668 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:23.537150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:23.537650 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:23.538278 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:23.538731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:23.539186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:23.673887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:23.682575 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:23.684069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:23.685178 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6bb5cf94-d74f-4438-be70-d077da9bdea1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.159459 Sep 16 03:53:23.685734 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 337/653] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:23 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:24.079586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:24.080243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:24.086537 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:24.087054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:24.087490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:24.088173 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:24.088641 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:24.089070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:24.216354 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:24.224072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bf84a3f5-383c-4613-a59d-96888eca68f9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.148503 Sep 16 03:53:24.224634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 317/654] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:24 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:24.710478 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:24.711192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:24.713022 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:24.713817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:24.719245 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:24.720482 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:24.721148 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:24.721946 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:24.722500 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:24.723249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:24.855647 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:24.868305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:24.868305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:24.868305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7e4a9e8b-c109-441a-9dd6-e28a0cf2a0fb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.159925 Sep 16 03:53:24.868630 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 338/655] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:24 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:25.013688 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-dd51a125-dcca-41f5-ae22-d07f920a10cd req-5e2d2d03-b1de-4f6a-9082-ed9e3dcccd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2263def2-54ff-4255-a751-2bdb7e32db67", "name": "network-vif-plugged", "status": "completed", "tag": "68bc6748-c4d5-4935-8d58-9b9bd27239ad"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:25.020043 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:25.025458 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-dd51a125-dcca-41f5-ae22-d07f920a10cd req-5e2d2d03-b1de-4f6a-9082-ed9e3dcccd56 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.025928 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-dd51a125-dcca-41f5-ae22-d07f920a10cd req-5e2d2d03-b1de-4f6a-9082-ed9e3dcccd56 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.026382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-dd51a125-dcca-41f5-ae22-d07f920a10cd req-5e2d2d03-b1de-4f6a-9082-ed9e3dcccd56 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.038285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-dd51a125-dcca-41f5-ae22-d07f920a10cd req-5e2d2d03-b1de-4f6a-9082-ed9e3dcccd56 service nova] Creating event network-vif-plugged:68bc6748-c4d5-4935-8d58-9b9bd27239ad for instance 2263def2-54ff-4255-a751-2bdb7e32db67 on hv-cinder-85799 Sep 16 03:53:25.043254 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-dd51a125-dcca-41f5-ae22-d07f920a10cd req-5e2d2d03-b1de-4f6a-9082-ed9e3dcccd56 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034461 Sep 16 03:53:25.044025 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 318/656] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:25.248668 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:25.249405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:25.256037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.256726 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.257232 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.257989 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.258511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.259041 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.299731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:25.302151 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:25.310564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.316855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.316855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.316855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.316855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.317243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.347995 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e8821e62-eaed-4826-900c-9f5b1db9c40e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057819 Sep 16 03:53:25.348576 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 319/657] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:53:25 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 03:53:25.406324 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:25.417287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:25.417790 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6b0c7ad5-a3b0-4dd0-b8a5-9faff59e607c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.172822 Sep 16 03:53:25.418060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:25.418503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 339/658] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:25 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:25.424330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.424756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.425193 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.425891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.426657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.427259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.455528 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:53:25.760301 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-06d9f571-7f8e-4ad3-9015-71b6ded37c15 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 204 len: 0 microversion: 2.1 time: 0.347188 Sep 16 03:53:25.760897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 320/659] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:53:25 2022] DELETE /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 03:53:25.769933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:25.770546 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:25.776898 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.777377 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.777810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.778536 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.779027 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.779530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.892093 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:25.893164 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:25.899015 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.899510 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.899948 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.900647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:25.901100 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:25.901522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:25.910478 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:25.918392 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3b619911-867a-4c04-ad90-c4b27bea8ce7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1672 microversion: 2.1 time: 0.152979 Sep 16 03:53:25.919142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 340/660] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:25 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:26.033177 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:26.042216 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:26.043675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:26.044911 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-54ffb6e2-baba-4d2c-a969-0dbd79b6534b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.157216 Sep 16 03:53:26.045463 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 321/661] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:25 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:26.441832 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:26.442448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:26.448645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:26.449129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:26.449564 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:26.450251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:26.450703 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:26.451159 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:26.583513 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:26.591319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a2760101-754a-4bf9-a285-11267b12631c tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.153484 Sep 16 03:53:26.591943 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 341/662] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:26 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:26.943886 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:26.944564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:26.950543 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:26.951101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:26.956425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:26.956425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:26.956425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:26.956425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:27.070797 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:27.071524 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:27.077879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:27.078370 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:27.078896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:27.079773 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:27.080230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:27.080796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:27.083906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:27.092621 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-51761e40-83f0-417a-b89b-d7069b89bfda tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1672 microversion: 2.1 time: 0.152725 Sep 16 03:53:27.093401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 322/663] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:26 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:27.221018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:27.228989 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:27.230426 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:27.231550 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-14151398-9b62-44c6-8380-b45ce5d7db08 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.164741 Sep 16 03:53:27.232105 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 342/664] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:27 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:53:27.615860 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:27.616465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:27.622553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:27.626001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:27.626001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:27.626001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:27.626001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:27.626521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:27.757429 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:27.765189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d26d2bd3-1d86-425c-a6f0-0a62e4d89c55 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.153154 Sep 16 03:53:27.765748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 323/665] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:27 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:28.116401 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:28.117076 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:28.123429 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:28.123912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:28.124345 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:28.125034 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:28.125493 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:28.125903 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:28.257214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:28.257821 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:28.258292 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:28.264808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:28.265308 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:28.265855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:28.266656 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:28.266796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-39bc2b1e-5335-4751-9316-42da358ae746 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1672 microversion: 2.1 time: 0.154158 Sep 16 03:53:28.267863 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:28.268461 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:28.272662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 343/666] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:28 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:28.495330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:28.506398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:28.507936 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:28.509420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a3b45cb3-4072-484b-90c8-7a87f92b72f2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1406 microversion: 2.20 time: 0.255734 Sep 16 03:53:28.515114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 324/667] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:28 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:28.789645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:28.790182 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:28.796091 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:28.797411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:28.797411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:28.797685 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:28.798137 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:28.798867 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:28.965177 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:28.973722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a77bdb77-6b3f-4323-8847-5d8dbc1f55b3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.187913 Sep 16 03:53:28.981667 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 344/668] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:28 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:29.291356 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:29.292180 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:29.302612 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:29.303189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:29.303694 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:29.304485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:29.317885 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:29.319720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:29.500812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-03dabf74-0a70-4399-97ff-134057eadc12 req-76e7136f-a7b0-4fc5-bed7-d1de584ca4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df7ed3f-dd6d-4312-a548-591443add019", "name": "network-vif-deleted", "tag": "88d08060-53df-4d74-b5dd-97e3666abaeb"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:29.519936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-03dabf74-0a70-4399-97ff-134057eadc12 req-76e7136f-a7b0-4fc5-bed7-d1de584ca4d3 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:29.523264 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-03dabf74-0a70-4399-97ff-134057eadc12 req-76e7136f-a7b0-4fc5-bed7-d1de584ca4d3 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:29.523947 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-03dabf74-0a70-4399-97ff-134057eadc12 req-76e7136f-a7b0-4fc5-bed7-d1de584ca4d3 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:29.545122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-03dabf74-0a70-4399-97ff-134057eadc12 req-76e7136f-a7b0-4fc5-bed7-d1de584ca4d3 service nova] Creating event network-vif-deleted:88d08060-53df-4d74-b5dd-97e3666abaeb for instance 2df7ed3f-dd6d-4312-a548-591443add019 on hv-cinder-85799 Sep 16 03:53:29.551706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-03dabf74-0a70-4399-97ff-134057eadc12 req-76e7136f-a7b0-4fc5-bed7-d1de584ca4d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056762 Sep 16 03:53:29.552693 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 345/669] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:53:29.560810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:29.561515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:29.583884 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:29.584533 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:29.585179 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:29.586057 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:29.586680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:29.587306 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:29.613854 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:29.620697 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ad8791dc-366a-4f0d-8f83-2da61336581e tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1604 microversion: 2.1 time: 0.328488 Sep 16 03:53:29.623140 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 325/670] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:29 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:30.000032 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:30.001277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:30.015697 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:30.016341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:30.017637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:30.020519 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:30.021256 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:30.024646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:30.139250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:30.151302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:30.152785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:30.154119 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-29dfacd4-79d8-46cf-9017-9fb3014f6a55 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1597 microversion: 2.20 time: 0.600355 Sep 16 03:53:30.154879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 346/671] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:53:29 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1597 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:53:30.175987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:30.184645 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d16c04bd-00c9-4d88-ac7f-ab2b892cfe54 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.188512 Sep 16 03:53:30.187025 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 326/672] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:29 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:30.240519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:30.241017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:30.247155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:30.247627 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:30.248063 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:30.248747 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:30.249189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:30.249606 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:30.252552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:30.338952 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-23491782-993e-4967-ae3b-6961c102bdc1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.163848 Sep 16 03:53:30.339676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 347/673] 10.222.0.49 () {60 vars in 1316 bytes} [Fri Sep 16 03:53:30 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:53:30.646092 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:30.646746 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:30.657087 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:30.657590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:30.658765 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:30.659519 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:30.660285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:30.660863 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:30.697559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:30.698041 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:30.698643 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:30.699286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'fault' on Instance uuid 2df7ed3f-dd6d-4312-a548-591443add019 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:30.741720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:30.749494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d0afde1a-c3e5-405f-b38f-068818285cfa tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1327 microversion: 2.1 time: 0.107510 Sep 16 03:53:30.750060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 327/674] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:30 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:31.210212 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:31.210926 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:31.217060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:31.217549 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:31.217984 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:31.218673 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:31.219167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:31.219593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:31.419079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:31.427071 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-770d6ef1-e18e-4127-a642-e6c59f7966e8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.221166 Sep 16 03:53:31.427661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 348/675] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:31 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:31.568424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-40d6aaf8-0cf5-4f65-807b-424fcc7fa2db req-f847be25-8c00-4137-a279-28430afea667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2263def2-54ff-4255-a751-2bdb7e32db67", "tag": "68bc6748-c4d5-4935-8d58-9b9bd27239ad"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:31.582665 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-40d6aaf8-0cf5-4f65-807b-424fcc7fa2db req-f847be25-8c00-4137-a279-28430afea667 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:31.583183 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-40d6aaf8-0cf5-4f65-807b-424fcc7fa2db req-f847be25-8c00-4137-a279-28430afea667 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:31.592458 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-40d6aaf8-0cf5-4f65-807b-424fcc7fa2db req-f847be25-8c00-4137-a279-28430afea667 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:31.595152 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-40d6aaf8-0cf5-4f65-807b-424fcc7fa2db req-f847be25-8c00-4137-a279-28430afea667 service nova] Creating event network-changed:68bc6748-c4d5-4935-8d58-9b9bd27239ad for instance 2263def2-54ff-4255-a751-2bdb7e32db67 on hv-cinder-85799 Sep 16 03:53:31.602069 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-40d6aaf8-0cf5-4f65-807b-424fcc7fa2db req-f847be25-8c00-4137-a279-28430afea667 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037952 Sep 16 03:53:31.602677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 328/676] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:31.772601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:31.773211 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:31.779201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:31.779680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:31.780109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:31.780798 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:31.781239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:31.781654 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:31.813177 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:31.813650 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:31.814654 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:31.815269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'fault' on Instance uuid 2df7ed3f-dd6d-4312-a548-591443add019 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:31.855251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:31.864326 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-11dda239-5692-4d0b-8ece-81a658b9b179 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1327 microversion: 2.1 time: 0.095510 Sep 16 03:53:31.864895 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 349/677] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:31 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:32.452670 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:32.453475 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:32.460751 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:32.461247 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:32.461679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:32.462415 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:32.463240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:32.463995 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:32.603448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:32.611968 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-736ed71d-d881-4a56-a000-abf05407b13f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.164016 Sep 16 03:53:32.612521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 329/678] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:32 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:32.887870 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:32.888719 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:32.895147 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:32.895624 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:32.896067 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:32.896728 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:32.897180 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:32.897599 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:32.928488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:32.928961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:32.929385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:32.929813 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'fault' on Instance uuid 2df7ed3f-dd6d-4312-a548-591443add019 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:32.972749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:32.981892 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3b45e4d8-3a89-4b7d-9700-a1d016baa3ea tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1327 microversion: 2.1 time: 0.097926 Sep 16 03:53:32.982436 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 350/679] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:32 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:33.635559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:33.636093 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:33.643181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:33.643667 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:33.644110 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:33.644797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:33.645259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:33.645684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:33.775148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:33.783108 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c021736b-730f-445c-8c8e-05e188e6c738 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.151360 Sep 16 03:53:33.783606 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 330/680] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:33 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:34.006937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:34.008166 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:34.016172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:34.016819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:34.017359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:34.018574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:34.019173 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:34.019697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:34.073234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:34.073717 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:34.074181 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:34.074620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'fault' on Instance uuid 2df7ed3f-dd6d-4312-a548-591443add019 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:34.120974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:34.129299 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8d90d80f-5429-4011-b54a-9fde0ee52412 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1327 microversion: 2.1 time: 0.128023 Sep 16 03:53:34.130149 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 351/681] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:33 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:34.807837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:34.809205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:34.817050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:34.825050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:34.825050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:34.825050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:34.825050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:34.825677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:34.969477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:34.972438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:34.978661 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3e1fb5e0-4f67-4826-a83d-45e151272e35 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.176491 Sep 16 03:53:34.979274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 331/682] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:34 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:35.153342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:35.153887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:35.164808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:35.165712 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:35.166714 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:35.167808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:35.168542 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:35.169073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:35.210080 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:35.210893 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:35.211732 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:35.212252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'fault' on Instance uuid 2df7ed3f-dd6d-4312-a548-591443add019 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:35.286842 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:35.294111 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4767078d-fea5-467a-8513-3deed8a59a99 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 200 len: 1327 microversion: 2.1 time: 0.144672 Sep 16 03:53:35.294825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 352/683] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:35 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 1327 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:36.002974 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:36.003614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:36.010485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:36.010997 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:36.011431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:36.012118 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:36.012602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:36.012987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:36.152474 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:36.160932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4295d678-2ce6-401d-81b9-31017ba82160 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1570 microversion: 2.1 time: 0.162816 Sep 16 03:53:36.161508 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 332/684] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:35 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:36.187139 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:36.187738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:36.194745 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:36.195380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:36.195815 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:36.196504 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:36.196956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:36.197380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:36.227831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127618) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 03:53:36.319168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:36.319778 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:36.329193 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:36.329696 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:36.330392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:36.331420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:36.331881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:36.332308 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:36.347199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] HTTP exception thrown: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Request method failure captured: Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 HTTP/1.1 Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IG9EW9gXsk9EoqLDEo1IaOSppDMpstPxJK2BGcL99eOsWhuO2Zk7AbMr4ExedU30Dj_V5wLU3LCroeyB-5kV2Vt-9i1qBR9XZCVa6-Rc1fVINIx4IM9Rr0mAXeI4PAcb8iIhrIrqCiXZoyRUwNeiF0gECfRZzdj4k0gLyB1y7XeQ8 Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:53:36.348795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}] Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 8f410d691e364880b13bb9144bbc5e7d Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:53:36.350305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '2df7ed3f-dd6d-4312-a548-591443add019'} Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:53:36.351217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:53:36.352372 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:53:36.353423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Returning 404 to user: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:53:36.353423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7e76a0da-bd45-4b5b-974c-080812d63498 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 404 len: 111 microversion: 2.1 time: 0.036352 Sep 16 03:53:36.353423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 333/685] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:36 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 03:53:36.358927 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-120e31ec-bd66-42cb-9bb6-f561c8fd53df tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '.version_select at 0x7fba7c5ff9d0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:36.446683 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-120e31ec-bd66-42cb-9bb6-f561c8fd53df tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085684248" status: 202 len: 0 microversion: 2.1 time: 0.091378 Sep 16 03:53:36.447509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 334/686] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Sep 16 03:53:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085684248 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 03:53:36.556684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ad08e321-93cf-4436-a707-66c0668b97ff tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "POST /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63/action" status: 202 len: 0 microversion: 2.1 time: 0.373421 Sep 16 03:53:36.557302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 353/687] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:53:36 2022] POST /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:53:36.566139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:36.566755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:36.574376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:36.574867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:36.575350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:36.576028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:36.576479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:36.576897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:36.768557 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:36.777350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-375480dd-b9ab-469b-89e6-2001703cf0ef tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1578 microversion: 2.1 time: 0.215818 Sep 16 03:53:36.778650 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 335/688] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:36 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:37.315879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9ce250ac-a7c7-4005-90f9-d6e4c93d05d4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'create', calling method: .version_select at 0x7fba7c625e50>, body: {"keypair": {"name": "tempest-keypair-2110307911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkyUqV8ySZ9Qua9v8e15rIpcwQV3NcUaaqZIZs35xZxdXxv/5rnwJwklzxB7uAdPWiG8EMnIrl/HtwIypgxhSl0TSZfBEX2AL6wvTlAB75h7KpKhajRroIEq1KmVSGSxw=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:37.333658 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-9ce250ac-a7c7-4005-90f9-d6e4c93d05d4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Getting quotas for project e94b50976295422c9c8374155cf2d2c2. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:53:37.337618 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-9ce250ac-a7c7-4005-90f9-d6e4c93d05d4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Getting quotas for user 8f410d691e364880b13bb9144bbc5e7d and project e94b50976295422c9c8374155cf2d2c2. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:53:37.441532 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9ce250ac-a7c7-4005-90f9-d6e4c93d05d4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130984 Sep 16 03:53:37.442123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 354/689] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:53:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:37.802506 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:37.803270 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:37.810011 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:37.810505 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:37.810971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:37.811824 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:37.812397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:37.812826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:37.967276 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:37.975409 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aa05f2db-0cdc-45a9-be3a-538f56d73a02 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1518 microversion: 2.1 time: 0.177493 Sep 16 03:53:37.975960 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 336/690] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:37 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:38.521911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:38.522737 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:38.534934 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:38.535922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:38.536377 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:38.537562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:38.538953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:38.539615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:38.631425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lazy-loading 'services' on Instance uuid aa7bab22-1639-467d-ba7a-94c97e1b9231 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:38.903818 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b475ed92-b401-475c-b3ee-c70d636ec5d6 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments/db7fc0d4-321f-44e8-8490-cdb726141bd5" status: 202 len: 0 microversion: 2.1 time: 0.387350 Sep 16 03:53:38.908127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 355/691] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:53:38 2022] DELETE /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments/db7fc0d4-321f-44e8-8490-cdb726141bd5 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:53:38.910070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-fdc1ba76-5ae3-4312-8632-fced57784302 req-c7f09205-d380-4c4f-99a2-dda8ddd83a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d52b03d-e8ff-4942-a9d3-33b7341dad63", "name": "network-vif-unplugged", "status": "completed", "tag": "2c25634f-27f9-4868-a4bb-0f555233fe5e"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:38.925704 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-fdc1ba76-5ae3-4312-8632-fced57784302 req-c7f09205-d380-4c4f-99a2-dda8ddd83a99 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:38.926591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-fdc1ba76-5ae3-4312-8632-fced57784302 req-c7f09205-d380-4c4f-99a2-dda8ddd83a99 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:38.927234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-fdc1ba76-5ae3-4312-8632-fced57784302 req-c7f09205-d380-4c4f-99a2-dda8ddd83a99 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:38.933823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:38.936203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:38.941554 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.compute.server_external_events [req-fdc1ba76-5ae3-4312-8632-fced57784302 req-c7f09205-d380-4c4f-99a2-dda8ddd83a99 service nova] Unable to find a host for instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63. Dropping event network-vif-unplugged {{(pid=127617) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 03:53:38.942593 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-fdc1ba76-5ae3-4312-8632-fced57784302 req-c7f09205-d380-4c4f-99a2-dda8ddd83a99 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040856 Sep 16 03:53:38.943638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:38.944208 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 337/692] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 16 03:53:38.944503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:38.944951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:38.945689 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:38.946092 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:38.946552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:38.979152 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-965546bc-7c72-477a-ba0c-7481d2aaffe7 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069444 Sep 16 03:53:38.979980 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 356/693] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:53:38 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:38.999565 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:39.000296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:39.007144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:39.007760 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:39.008433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:39.009386 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:39.009934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:39.010444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:39.174235 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:39.183326 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-67076d43-d809-4310-95f6-cab1f5e0c1c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1520 microversion: 2.1 time: 0.187970 Sep 16 03:53:39.183893 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 338/694] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:38 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:39.992752 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:39.994927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:40.001270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:40.001782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:40.002214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:40.003021 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:40.004060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:40.004418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:40.037749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6f31ab11-8e04-4069-8265-0f64da6b9fcf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049194 Sep 16 03:53:40.038357 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 357/695] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:53:39 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:40.091772 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1720988097", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96000232-5a2c-4cbe-8524-4ab75044ef77"}], "security_groups": [{"name": "tempest-securitygroup--1176635877"}], "key_name": "tempest-keypair-2110307911", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:40.205680 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] validate_networks() for [('96000232-5a2c-4cbe-8524-4ab75044ef77', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:53:40.207442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:40.208056 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:40.214155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:40.214688 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:40.215234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:40.215838 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:40.216284 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:40.216976 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:40.366154 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:40.374165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e57e4190-925e-4fd3-9238-ab4133b6604b tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.170954 Sep 16 03:53:40.395147 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 358/696] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:40 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:40.666367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:53:40.666858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:53:40.667365 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:53:40.667776 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:53:40.668320 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:53:40.677399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:40.677887 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:40.678489 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:40.679248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:40.679710 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:40.680135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:40.697572 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Getting quotas for project e94b50976295422c9c8374155cf2d2c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:53:40.701707 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Getting quotas for user 8f410d691e364880b13bb9144bbc5e7d and project e94b50976295422c9c8374155cf2d2c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:53:40.704326 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:40.714672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:53:40.717039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:53:40.854134 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-273972a4-e7df-4467-93d7-d6a148a9e804 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.766707 Sep 16 03:53:40.854883 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 339/697] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:53:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:53:40.867652 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-668c9d6d-d45e-48ef-8b92-3c11137de44a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:40.867652 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-668c9d6d-d45e-48ef-8b92-3c11137de44a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:40.937237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-668c9d6d-d45e-48ef-8b92-3c11137de44a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:40.949785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-668c9d6d-d45e-48ef-8b92-3c11137de44a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1238 microversion: 2.1 time: 0.087492 Sep 16 03:53:40.950562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 359/698] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:40 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:41.055034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:41.057796 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:41.069315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.069805 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.070237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.070949 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.071399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.071812 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.104327 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-86ea1a75-701b-4655-ade3-37b71ee813eb tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054047 Sep 16 03:53:41.105185 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 340/699] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:53:41 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 03:53:41.188541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:41.189064 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:41.198778 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.199321 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.199748 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.200487 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.200941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.201359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.227107 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:53:41.458018 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:41.458620 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:41.465239 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.465731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.466139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.466811 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.467482 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.467899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.603273 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:41.614349 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-87dc2ef8-8bbd-4694-82a0-9b2bdf5a7584 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.160776 Sep 16 03:53:41.614950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 341/700] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:41 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:41.651485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b5e5e0b1-f686-4edf-b2fe-079e9244f11c tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 204 len: 0 microversion: 2.1 time: 0.466724 Sep 16 03:53:41.652112 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 360/701] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:53:41 2022] DELETE /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:53:41.660591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:41.661198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:41.667274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.667749 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.668180 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.668879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.669305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.669720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.796881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:41.805184 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-285c6fec-2321-4176-b3fc-909e5fe4687d tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1687 microversion: 2.1 time: 0.148958 Sep 16 03:53:41.805751 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 342/702] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:41 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:41.975050 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:41.975891 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:41.981906 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.982379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.982807 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.983526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:41.983970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:41.984388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:41.999416 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:42.049464 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:42.057297 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bd5cae7e-9261-4ae0-8913-74aa0ea588a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1242 microversion: 2.1 time: 0.087451 Sep 16 03:53:42.057853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 361/703] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:41 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:42.638294 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:42.638954 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:42.646250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:42.646726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:42.647188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:42.647868 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:42.648315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:42.648753 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:42.782315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:42.790797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ca0b73a2-28b9-4866-901d-0eef6d1a63b7 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.156747 Sep 16 03:53:42.791392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 343/704] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:42 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:42.829057 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:42.829667 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:42.837306 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:42.844017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:42.844017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:42.844017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:42.844017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:42.844410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:42.968703 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:42.977327 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-71886413-3edf-413f-8190-ea84678d2c9f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1687 microversion: 2.1 time: 0.152440 Sep 16 03:53:42.977894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 362/705] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:42 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:43.080004 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:43.080528 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:43.087496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:43.087977 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:43.088408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:43.089082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:43.089545 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:43.089965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:43.151021 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:43.158772 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-749b1852-5eb1-45e6-95ff-ec16a30b5bd5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1242 microversion: 2.1 time: 0.082670 Sep 16 03:53:43.160027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 344/706] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:43 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:43.815019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:43.815752 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:43.822567 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:43.823069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:43.823502 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:43.831680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:43.831680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:43.831680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:43.965220 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:43.973242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-46c9c094-f679-48a6-b9fb-768f026819c8 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.162561 Sep 16 03:53:43.973933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 363/707] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:43 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:44.001164 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:44.001770 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:44.008821 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:44.009299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:44.009726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:44.010403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:44.010873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:44.011305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:44.148479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:44.158727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bcc122e8-dde0-4301-a859-adb5fb64f8d8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1687 microversion: 2.1 time: 0.161373 Sep 16 03:53:44.159291 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 345/708] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:43 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:44.183195 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:44.183830 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:44.190244 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:44.192536 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:44.192536 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:44.192879 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:44.193342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:44.193765 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:44.254727 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:44.262342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3ed78fba-4bbe-4993-ab3e-551aebb621f8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1242 microversion: 2.1 time: 0.083981 Sep 16 03:53:44.262919 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 364/709] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:44 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:44.996732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:44.997395 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:45.003221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:45.003780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:45.004124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:45.004891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:45.005341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:45.005757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:45.146216 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:45.153939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-77273983-dee6-4ffb-b2f9-658b885e3701 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.161142 Sep 16 03:53:45.154502 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 346/710] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:44 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:45.183246 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:45.183794 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:45.187203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:45.190449 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:45.190944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:45.191380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:45.192100 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:45.192545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:45.192969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:45.284609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:45.285218 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:45.291026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:45.291534 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:45.291964 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:45.292655 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:45.293102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:45.293518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:45.405231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:45.414710 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d4690d18-db98-495a-8cc1-c9aeb16b1de3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1242 microversion: 2.1 time: 0.133857 Sep 16 03:53:45.442603 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 347/711] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:45 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:45.660574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:45.668380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d5e8801c-0a1c-429c-9e1d-99c0f3fa6c85 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1687 microversion: 2.1 time: 0.489352 Sep 16 03:53:45.668955 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 365/712] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:45 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1687 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:46.179275 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:46.180022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:46.186744 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:46.187255 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:46.187694 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:46.188384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:46.188838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:46.189259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:46.381707 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:46.396810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-530ee70e-abc6-4d5b-8f64-8b5c0f22fecb tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.221978 Sep 16 03:53:46.397616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 348/713] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:46 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:46.440873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:46.441622 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:46.448235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:46.448785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:46.449259 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:46.449955 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:46.453334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:46.453334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:46.541781 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:46.554196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b4037e70-19ab-4819-a3c1-a0565d4bb578 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1290 microversion: 2.1 time: 0.116457 Sep 16 03:53:46.555191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 366/714] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:46 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:46.664816 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-6b7fa49e-2c3c-48c8-b94b-817c72fe49e6 req-5198a0f9-096d-49b2-bc84-9e2b311f0006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7bab22-1639-467d-ba7a-94c97e1b9231", "name": "network-vif-deleted", "tag": "552dfee7-ff27-4901-a9cb-8d274e8becd6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:46.682487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-6b7fa49e-2c3c-48c8-b94b-817c72fe49e6 req-5198a0f9-096d-49b2-bc84-9e2b311f0006 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:46.686875 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-6b7fa49e-2c3c-48c8-b94b-817c72fe49e6 req-5198a0f9-096d-49b2-bc84-9e2b311f0006 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:46.692518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:46.693733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:46.700043 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-6b7fa49e-2c3c-48c8-b94b-817c72fe49e6 req-5198a0f9-096d-49b2-bc84-9e2b311f0006 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:46.705857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:46.709913 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:46.710779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:46.713265 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:46.714284 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:46.721018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:46.728249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-6b7fa49e-2c3c-48c8-b94b-817c72fe49e6 req-5198a0f9-096d-49b2-bc84-9e2b311f0006 service nova] Creating event network-vif-deleted:552dfee7-ff27-4901-a9cb-8d274e8becd6 for instance aa7bab22-1639-467d-ba7a-94c97e1b9231 on hv-cinder-85799 Sep 16 03:53:46.734043 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-6b7fa49e-2c3c-48c8-b94b-817c72fe49e6 req-5198a0f9-096d-49b2-bc84-9e2b311f0006 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073499 Sep 16 03:53:46.735284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 349/715] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:46.853259 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:46.863065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-75898e4c-7c6b-481f-9e65-a7430a5737d5 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1620 microversion: 2.1 time: 0.174408 Sep 16 03:53:46.866252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 367/716] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:46 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1620 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:47.422557 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:47.423284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:47.430435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:47.430934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:47.440720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:47.440720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:47.440720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:47.440720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:47.586526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:47.587806 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:47.608503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:47.609241 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:47.609700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:47.610651 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:47.611287 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:47.611703 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:47.702631 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:47.717200 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-59ad5e9c-1f44-446e-b3cd-7d7605a9acdc tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1308 microversion: 2.1 time: 0.138211 Sep 16 03:53:47.718737 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 368/717] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:47 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1308 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:47.719224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:47.729636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b915e19c-8f08-4f80-8308-044e542352c6 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.312153 Sep 16 03:53:47.730215 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 350/718] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:47 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:47.887928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:47.889580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:47.897492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:47.898205 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:47.898873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:47.900309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:47.901124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:47.901773 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:47.954201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:47.955019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:47.955749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:47.956349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lazy-loading 'fault' on Instance uuid aa7bab22-1639-467d-ba7a-94c97e1b9231 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:53:48.016367 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:48.024786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-12eff02c-ce89-428b-8943-e5e8e3259a96 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 200 len: 1334 microversion: 2.1 time: 0.141311 Sep 16 03:53:48.027377 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 369/719] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:47 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 1334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:48.742727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:48.743368 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:48.750603 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:48.751120 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:48.751587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:48.752377 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:48.752972 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:48.753398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:48.756137 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:48.757068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:48.763855 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:48.764559 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:48.764998 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:48.765701 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:48.766159 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:48.766616 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:48.979250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:48.990540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-01140dc3-8d47-45b2-87e9-185c8ff04278 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.239468 Sep 16 03:53:48.991319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 370/720] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:48 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:49.049688 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:49.055881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:49.055881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: aa7bab22-1639-467d-ba7a-94c97e1b9231] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:49.059228 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:49.061025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:49.061663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:49.062075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3c36501d-7c76-4c56-ab9c-de5fd447ee5c tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.323437 Sep 16 03:53:49.062811 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 351/721] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:48 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:49.063040 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:49.063670 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:49.063924 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:49.078326 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] HTTP exception thrown: Instance aa7bab22-1639-467d-ba7a-94c97e1b9231 could not be found. Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Request method failure captured: Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 HTTP/1.1 Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IQJXyFJdHaMqBjeHrrX6Vc1xzZgD1ImELyXYJrUZwdAsqBKD1-4JJwShHN6JJiLxATqXwbGbUt4LTiPZxdSHBtKReRq2iPr19u7dHdT0PEwFAbTNlt9KE6AsRMQTcqEFePru42CEaC430wnwaGuQ5QX4fLiSO4iDxqHDBTRWlT8Yg Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:53:49.080089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}] Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: a6b29b9086f64ea7a7990572567642f7 Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance aa7bab22-1639-467d-ba7a-94c97e1b9231 could not be found. Sep 16 03:53:49.081485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'aa7bab22-1639-467d-ba7a-94c97e1b9231'} Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7bab22-1639-467d-ba7a-94c97e1b9231 could not be found. Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:53:49.082593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7bab22-1639-467d-ba7a-94c97e1b9231 could not be found. Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7bab22-1639-467d-ba7a-94c97e1b9231 could not be found. Sep 16 03:53:49.084440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:53:49.087251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Returning 404 to user: Instance aa7bab22-1639-467d-ba7a-94c97e1b9231 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:53:49.087251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b4df12da-2b53-488d-b8fa-9d139399c60b tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231" status: 404 len: 111 microversion: 2.1 time: 0.035737 Sep 16 03:53:49.087251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 371/722] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:49 2022] GET /compute/v2.1/servers/aa7bab22-1639-467d-ba7a-94c97e1b9231 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 03:53:49.090472 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0e5eb9f7-243e-401b-b45a-a248937da8ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '.version_select at 0x7fba7c61be50>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:49.226027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0e5eb9f7-243e-401b-b45a-a248937da8ae tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218737133" status: 202 len: 0 microversion: 2.1 time: 0.139138 Sep 16 03:53:49.226771 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 352/723] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 16 03:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218737133 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 03:53:49.813509 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-c01eac53-637a-45cf-8244-1c9f85287c28 req-a3ba06c5-a3d4-46fc-a9e3-c24ba0408dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8514653-8ce9-41b6-ba9f-d30377c5fae4", "tag": "0d6f5f36-2095-4132-9bda-3dd4c203721f"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:49.825697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c01eac53-637a-45cf-8244-1c9f85287c28 req-a3ba06c5-a3d4-46fc-a9e3-c24ba0408dc0 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:49.826175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c01eac53-637a-45cf-8244-1c9f85287c28 req-a3ba06c5-a3d4-46fc-a9e3-c24ba0408dc0 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:49.826604 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c01eac53-637a-45cf-8244-1c9f85287c28 req-a3ba06c5-a3d4-46fc-a9e3-c24ba0408dc0 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:49.841209 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-c01eac53-637a-45cf-8244-1c9f85287c28 req-a3ba06c5-a3d4-46fc-a9e3-c24ba0408dc0 service nova] Creating event network-changed:0d6f5f36-2095-4132-9bda-3dd4c203721f for instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 on hv-cinder-85799 Sep 16 03:53:49.847285 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-c01eac53-637a-45cf-8244-1c9f85287c28 req-a3ba06c5-a3d4-46fc-a9e3-c24ba0408dc0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202218 Sep 16 03:53:49.848279 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 372/724] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:50.016319 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:50.017568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:50.030103 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:50.032567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:50.033552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:50.034469 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:50.034975 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:50.035731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:50.059029 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:50.087505 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:50.088226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:50.094600 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:50.095122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:50.095563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:50.096293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:50.096746 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:50.097166 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:50.249140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:50.258004 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:50.260752 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4a8d9696-7b6a-4298-9bfc-34c12aebc700 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.178290 Sep 16 03:53:50.262141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 373/725] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:50 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:50.281451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a3e3f884-d5a1-4c92-83ae-b1be474794ca tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.268831 Sep 16 03:53:50.282045 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 353/726] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:50 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:51.016015 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-43641cfe-b163-48f6-8b62-9cb660414107 req-b010082c-c6c1-484b-8976-c5f388db624e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d52b03d-e8ff-4942-a9d3-33b7341dad63", "name": "network-vif-plugged", "status": "completed", "tag": "2c25634f-27f9-4868-a4bb-0f555233fe5e"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:51.022260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:51.027606 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-43641cfe-b163-48f6-8b62-9cb660414107 req-b010082c-c6c1-484b-8976-c5f388db624e service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:51.028072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-43641cfe-b163-48f6-8b62-9cb660414107 req-b010082c-c6c1-484b-8976-c5f388db624e service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:51.028494 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-43641cfe-b163-48f6-8b62-9cb660414107 req-b010082c-c6c1-484b-8976-c5f388db624e service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:51.040484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-43641cfe-b163-48f6-8b62-9cb660414107 req-b010082c-c6c1-484b-8976-c5f388db624e service nova] Creating event network-vif-plugged:2c25634f-27f9-4868-a4bb-0f555233fe5e for instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 on hv-cinder-85799 Sep 16 03:53:51.045682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-43641cfe-b163-48f6-8b62-9cb660414107 req-b010082c-c6c1-484b-8976-c5f388db624e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033562 Sep 16 03:53:51.046262 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 374/727] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:51.289348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:51.289963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:51.291833 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:51.292494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:51.297778 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:51.298271 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:51.298711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:51.299530 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:51.299984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:51.300410 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:51.308522 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:51.313027 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:51.316681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:51.317569 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:51.318304 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:51.319091 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:51.320267 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:51.320267 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:51.450440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:51.458880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e0fbb1ed-7349-40a1-95f3-e80a4b9c439d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.174409 Sep 16 03:53:51.459670 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 354/728] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:51 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:51.464252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:51.471951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4d7af96a-4a4e-4f0f-a0cd-98fe46071363 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.168823 Sep 16 03:53:51.472515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 375/729] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:51 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:52.482708 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:52.483351 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:52.490435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:52.490900 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:52.491350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:52.492028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:52.492477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:52.492893 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:52.495632 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:52.496250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:52.503035 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:52.503521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:52.504582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:52.505281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:52.505725 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:52.506144 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:52.627337 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:52.637040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-63729c65-18ee-4649-8a89-c4291d20edc8 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.158112 Sep 16 03:53:52.645321 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 355/730] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:52 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:52.653954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:52.662316 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-36d91ccb-f732-4253-a204-fa26df93d517 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.170481 Sep 16 03:53:52.662871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 376/731] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:52 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:53.661461 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:53.662066 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:53.668352 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:53.668835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:53.669309 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:53.669983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:53.670514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:53.670957 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:53.685996 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:53.686642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:53.694068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:53.694456 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:53.694853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:53.695573 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:53.696026 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:53.696486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:53.814633 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:53.823197 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a824fca0-865d-49f0-928c-4441cb719f47 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.166126 Sep 16 03:53:53.824060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 356/732] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:53 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:53.835643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:53.844118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1b51c91e-2a16-4804-ba3d-a8a37d08c8c2 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.162062 Sep 16 03:53:53.844672 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 377/733] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:53 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:53.949716 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:53.950229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:53.956534 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:53.957159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:53.957594 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:53.958277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:53.958719 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:53.959159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:53.982218 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-033345fe-3f02-4790-aba4-d97287a5b512 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/ips" status: 200 len: 150 microversion: 2.1 time: 0.150267 Sep 16 03:53:53.982763 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 357/734] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:53:53 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/ips => generated 150 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:54.772377 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:54.775124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:54.779204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:54.779680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:54.780112 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:54.780800 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:54.781240 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:54.781659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:54.806666 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:53:54.838383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:54.847400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:54.848866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:54.855493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:54.856088 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:54.856535 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:54.857245 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:54.857701 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:54.858138 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:54.999956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:55.008408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0feb4245-cb77-4e7f-b29f-c4e4366874f4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.165349 Sep 16 03:53:55.008910 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 358/735] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:54 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:55.028570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:55.029174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:55.034901 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:55.035443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:55.035996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:55.036657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:55.037100 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:55.037515 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:55.170258 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:55.178089 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d8a7aa24-b0cb-439c-baf0-a917d7e304dc tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.153256 Sep 16 03:53:55.178678 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 359/736] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:55 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:55.234273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a2a597a0-33a4-4e8e-9f99-5b8632706bec tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 204 len: 0 microversion: 2.1 time: 0.465934 Sep 16 03:53:55.234883 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 378/737] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:53:54 2022] DELETE /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:53:55.243922 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:55.244529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:55.250773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:55.251292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:55.251802 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:55.252398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:55.252843 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:55.253263 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:55.384413 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:55.392014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-63a45eb9-8beb-40fc-97f4-b723eb37536f tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1507 microversion: 2.1 time: 0.152489 Sep 16 03:53:55.392577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 360/738] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:55 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:55.745700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45c7792e-0f33-48b3-8a50-09b9f19b1e53"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:55.748254 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:55.754812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:55.757078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:55.757078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:55.757078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:55.757078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:55.757449 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:56.031232 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:56.031835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:56.038344 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:56.038821 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:56.039276 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:56.039953 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:56.040395 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:56.040810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:56.401755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:56.409795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-43a6d147-e5c1-48a1-b5c2-819bbe670131 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.382351 Sep 16 03:53:56.410447 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 361/739] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:56 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:56.415375 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:56.415985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:56.421681 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:56.422156 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:56.422579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:56.423292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:56.423740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:56.424152 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:56.563153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:56.570974 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f605d983-071d-4bf8-8a7c-3d6b75daa679 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.159194 Sep 16 03:53:56.571555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 362/740] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:56 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:56.576091 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:56.576696 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:56.582567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:56.582705 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:56.583178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:56.583865 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:56.584316 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:56.584741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:56.714002 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:56.721617 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6e7e3122-3b7f-446b-9d54-eca0477ddac9 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1507 microversion: 2.1 time: 0.149123 Sep 16 03:53:56.722176 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 363/741] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:56 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:57.136299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-f406c85c-f10a-447d-9a59-0c2512e92cfd req-67b9b72d-3014-402c-b5a1-fc0e7d2e1b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8514653-8ce9-41b6-ba9f-d30377c5fae4", "name": "network-vif-plugged", "status": "completed", "tag": "0d6f5f36-2095-4132-9bda-3dd4c203721f"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:57.146757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f406c85c-f10a-447d-9a59-0c2512e92cfd req-67b9b72d-3014-402c-b5a1-fc0e7d2e1b99 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:57.147259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f406c85c-f10a-447d-9a59-0c2512e92cfd req-67b9b72d-3014-402c-b5a1-fc0e7d2e1b99 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:57.147685 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f406c85c-f10a-447d-9a59-0c2512e92cfd req-67b9b72d-3014-402c-b5a1-fc0e7d2e1b99 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:57.158304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-f406c85c-f10a-447d-9a59-0c2512e92cfd req-67b9b72d-3014-402c-b5a1-fc0e7d2e1b99 service nova] Creating event network-vif-plugged:0d6f5f36-2095-4132-9bda-3dd4c203721f for instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 on hv-cinder-85799 Sep 16 03:53:57.164338 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-f406c85c-f10a-447d-9a59-0c2512e92cfd req-67b9b72d-3014-402c-b5a1-fc0e7d2e1b99 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031718 Sep 16 03:53:57.164910 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 364/742] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:53:57.434224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:57.434947 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:57.441032 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:57.442015 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:57.442443 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:57.443147 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:57.443595 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:57.444019 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:57.580838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:57.589408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-980638fc-21eb-4141-93fa-fca1c8a19949 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.159995 Sep 16 03:53:57.589984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 365/743] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:57 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:57.594623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:57.595382 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:57.601412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:57.601900 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:57.602332 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:57.603052 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:57.603507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:57.608458 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:57.750392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:57.758885 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3dcf289a-2856-470b-a736-7076eb221e6f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1576 microversion: 2.1 time: 0.167680 Sep 16 03:53:57.764498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 366/744] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:57 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:57.764498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:57.768653 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:57.770936 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:57.771414 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:57.771854 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:57.772548 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:57.772996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:57.773419 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:57.913290 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:57.921181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-38ab026b-590d-4406-be42-fa087f32e4df tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1507 microversion: 2.1 time: 0.160676 Sep 16 03:53:57.921750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 367/745] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:57 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:53:58.613973 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:58.614609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:58.621507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:58.622124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:58.622564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:58.623297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:58.623886 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:58.624317 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:58.759958 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:58.773145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-450b153e-2dcf-4790-b1aa-0feb006ab3c5 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.163497 Sep 16 03:53:58.773726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 368/746] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:58 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:58.784668 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:58.789147 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:58.791605 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3f3c78dc-346d-4db8-925a-8d2331e8a757 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.050053 Sep 16 03:53:58.792107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:58.792432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:58.792871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 379/747] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:53:55 2022] POST /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments => generated 194 bytes in 3052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:58.793289 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:58.793983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:58.794431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:58.794847 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:58.955580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:58.955580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:58.961138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:58.964445 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:58.967678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:58.970301 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:58.973949 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8e8abb02-ab17-4e03-93c4-e4416dd34488 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1563 microversion: 2.1 time: 0.192697 Sep 16 03:53:58.974585 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:58.975465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:58.976101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:58.979721 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 369/748] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:58 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1563 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:59.077582 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:59.090094 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bd520ebd-d580-4eb9-87a0-72022e2c3fa4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1465 microversion: 2.1 time: 0.149422 Sep 16 03:53:59.105548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 380/749] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:58 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1465 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:53:59.163388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-55d3e324-1205-48a9-b44a-bc125a9804fd req-59910d2e-dea8-46bb-9ac9-83a3dceb3a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806", "name": "network-vif-deleted", "tag": "638a834b-f18e-4522-9cce-b0662c140379"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:53:59.173112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-55d3e324-1205-48a9-b44a-bc125a9804fd req-59910d2e-dea8-46bb-9ac9-83a3dceb3a81 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:59.173594 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-55d3e324-1205-48a9-b44a-bc125a9804fd req-59910d2e-dea8-46bb-9ac9-83a3dceb3a81 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:59.174054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-55d3e324-1205-48a9-b44a-bc125a9804fd req-59910d2e-dea8-46bb-9ac9-83a3dceb3a81 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:59.186535 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-55d3e324-1205-48a9-b44a-bc125a9804fd req-59910d2e-dea8-46bb-9ac9-83a3dceb3a81 service nova] Creating event network-vif-deleted:638a834b-f18e-4522-9cce-b0662c140379 for instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 on hv-cinder-85799 Sep 16 03:53:59.192398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-55d3e324-1205-48a9-b44a-bc125a9804fd req-59910d2e-dea8-46bb-9ac9-83a3dceb3a81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191401 Sep 16 03:53:59.193107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 370/750] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:53:59.799697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:53:59.800425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:53:59.808526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:59.809746 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:59.810194 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:59.810900 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:53:59.811388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:53:59.811998 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:53:59.958983 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:53:59.968860 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-87c4230b-5862-47a3-a902-bc059fd8260b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1364 microversion: 2.1 time: 0.172853 Sep 16 03:53:59.969123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 381/751] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:53:59 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:00.113273 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:00.114767 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:00.121727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:00.122234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:00.122747 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:00.123544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:00.124070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:00.124579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:00.140770 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:00.159489 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:00.160591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:00.161715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:00.162165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lazy-loading 'fault' on Instance uuid 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:54:00.207561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:00.215431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-25202b79-5e83-4cc3-97c5-fdae864985e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 200 len: 1312 microversion: 2.1 time: 0.106585 Sep 16 03:54:00.227745 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 371/752] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:00 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:00.992922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:00.993531 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:00.999955 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.000499 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.000935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.001659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.002106 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.002521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.139110 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:01.146752 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7de2cb57-f9da-4615-ba08-764efaf9892b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1550 microversion: 2.1 time: 0.158408 Sep 16 03:54:01.147337 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 382/753] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:00 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:01.169919 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:01.170454 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:01.177921 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.178363 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.178794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.179549 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.180006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.180429 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.244765 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:01.245384 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:01.251242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.251729 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.252189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.252887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.253337 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.254393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.262682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dfe1859f-cf27-4fdf-aa51-6bcbf513edc4 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096945 Sep 16 03:54:01.263324 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 372/754] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 16 03:54:01 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:01.273938 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] HTTP exception thrown: Instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 could not be found. Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Request method failure captured: Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 HTTP/1.1 Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IQJXyFJdHaMqBjeHrrX6Vc1xzZgD1ImELyXYJrUZwdAsqBKD1-4JJwShHN6JJiLxATqXwbGbUt4LTiPZxdSHBtKReRq2iPr19u7dHdT0PEwFAbTNlt9KE6AsRMQTcqEFePru42CEaC430wnwaGuQ5QX4fLiSO4iDxqHDBTRWlT8Yg Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:54:01.275687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}] Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: a6b29b9086f64ea7a7990572567642f7 Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 could not be found. Sep 16 03:54:01.277078 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806'} Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 could not be found. Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:54:01.277971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 could not be found. Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 could not be found. Sep 16 03:54:01.279268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:01.280383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Returning 404 to user: Instance 14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:54:01.280383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2c222d3b-fc63-46e2-89ce-688ebb3f8d1a tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806" status: 404 len: 111 microversion: 2.1 time: 0.036396 Sep 16 03:54:01.280383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 383/755] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:01 2022] GET /compute/v2.1/servers/14a093b2-7d0f-4e11-8cc7-d1a2eb7a5806 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 03:54:01.288077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:01.288077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:01.298786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.299313 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.299753 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.300441 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.300926 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.301349 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.340361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:54:01.765867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-15878044-61c9-43b3-9bdf-c517a0b933c4 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 204 len: 0 microversion: 2.1 time: 0.483257 Sep 16 03:54:01.766930 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 373/756] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:54:01 2022] DELETE /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:54:01.775948 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:01.777102 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:01.783043 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.783718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.784340 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:01.785339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:01.785780 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:01.786210 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:02.019142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:02.028259 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0e687d3f-a771-4ac8-a97f-44eec8d17c0e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.256402 Sep 16 03:54:02.029017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 384/757] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:01 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:02.469954 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-90ad9be2-5711-4803-b2e8-172fcf0159cb req-7bd7c5da-6e2b-4ebb-ab25-c756693d14d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8514653-8ce9-41b6-ba9f-d30377c5fae4", "tag": "0d6f5f36-2095-4132-9bda-3dd4c203721f"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:02.488613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-90ad9be2-5711-4803-b2e8-172fcf0159cb req-7bd7c5da-6e2b-4ebb-ab25-c756693d14d1 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:02.489053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-90ad9be2-5711-4803-b2e8-172fcf0159cb req-7bd7c5da-6e2b-4ebb-ab25-c756693d14d1 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:02.489555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-90ad9be2-5711-4803-b2e8-172fcf0159cb req-7bd7c5da-6e2b-4ebb-ab25-c756693d14d1 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:02.515135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-90ad9be2-5711-4803-b2e8-172fcf0159cb req-7bd7c5da-6e2b-4ebb-ab25-c756693d14d1 service nova] Creating event network-changed:0d6f5f36-2095-4132-9bda-3dd4c203721f for instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 on hv-cinder-85799 Sep 16 03:54:02.521668 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-90ad9be2-5711-4803-b2e8-172fcf0159cb req-7bd7c5da-6e2b-4ebb-ab25-c756693d14d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056119 Sep 16 03:54:02.527532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 374/758] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:03.051916 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:03.053349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:03.062096 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:03.062663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:03.063190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:03.064091 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:03.064602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:03.065359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:03.342530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:03.352265 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-72f344fc-764c-4dee-80fa-85176d99483e tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.304833 Sep 16 03:54:03.371897 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 385/759] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:03 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:04.382364 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:04.383951 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:04.397393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:04.400073 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:04.400964 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:04.402491 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:04.403243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:04.403818 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:04.799429 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:04.810245 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3695d81c-8816-4558-9cf1-97e1864423ed tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1522 microversion: 2.1 time: 0.434270 Sep 16 03:54:04.811165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 375/760] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:04 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:05.356030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-8053666f-8288-4dfe-9302-59745d8e2948 req-03886a06-cb95-4f5b-aeb4-a67f9b8261b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea00b9d-1f8f-4428-98f7-9d66fd079c6d", "name": "network-vif-deleted", "tag": "8e2fa910-3468-43c4-b9c0-ed6a542e2f12"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:05.376266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8053666f-8288-4dfe-9302-59745d8e2948 req-03886a06-cb95-4f5b-aeb4-a67f9b8261b9 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:05.380779 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8053666f-8288-4dfe-9302-59745d8e2948 req-03886a06-cb95-4f5b-aeb4-a67f9b8261b9 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:05.381682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8053666f-8288-4dfe-9302-59745d8e2948 req-03886a06-cb95-4f5b-aeb4-a67f9b8261b9 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:05.397673 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-8053666f-8288-4dfe-9302-59745d8e2948 req-03886a06-cb95-4f5b-aeb4-a67f9b8261b9 service nova] Creating event network-vif-deleted:8e2fa910-3468-43c4-b9c0-ed6a542e2f12 for instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d on hv-cinder-85799 Sep 16 03:54:05.404766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-8053666f-8288-4dfe-9302-59745d8e2948 req-03886a06-cb95-4f5b-aeb4-a67f9b8261b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057986 Sep 16 03:54:05.405364 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 386/761] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:05.836439 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:05.839185 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:05.846536 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:05.847208 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:05.848956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:05.849679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:05.850268 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:05.851175 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:05.925236 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:05.927359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:05.928003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:05.928616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lazy-loading 'fault' on Instance uuid 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:54:06.004935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b29b9086f64ea7a7990572567642f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac97d1487c024a68b8ad933d882bb456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:06.010991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1a1e0bfc-57fb-4f1e-a5f6-de88cb6e1baf tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 200 len: 1312 microversion: 2.1 time: 0.179933 Sep 16 03:54:06.012156 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 376/762] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:05 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:06.463930 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45c7792e-0f33-48b3-8a50-09b9f19b1e53"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:06.467219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:06.476821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:06.478409 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:06.479597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:06.484056 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:06.484893 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:06.485658 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:06.619817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Invalid volume: volume 45c7792e-0f33-48b3-8a50-09b9f19b1e53 is already attached to instances: bb6e8c47-3155-423c-ac27-8e71fc56bbce Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: POST /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments HTTP/1.1 Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 74 Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:54:06.621825 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {"volumeAttachment": {"volumeId": "45c7792e-0f33-48b3-8a50-09b9f19b1e53"}} Sep 16 03:54:06.623333 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Invalid volume: volume 45c7792e-0f33-48b3-8a50-09b9f19b1e53 is already attached to instances: bb6e8c47-3155-423c-ac27-8e71fc56bbce Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'server_id': 'bb6e8c47-3155-423c-ac27-8e71fc56bbce', 'body': {'volumeAttachment': {'volumeId': '45c7792e-0f33-48b3-8a50-09b9f19b1e53'}}} Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 45c7792e-0f33-48b3-8a50-09b9f19b1e53 is already attached to instances: bb6e8c47-3155-423c-ac27-8e71fc56bbce Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:06.624125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 45c7792e-0f33-48b3-8a50-09b9f19b1e53 is already attached to instances: bb6e8c47-3155-423c-ac27-8e71fc56bbce Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:06.626928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:54:06.629141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:54:06.629141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:54:06.629141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:54:06.629141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 45c7792e-0f33-48b3-8a50-09b9f19b1e53 is already attached to instances: bb6e8c47-3155-423c-ac27-8e71fc56bbce Sep 16 03:54:06.629141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:06.629141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 400 to user: Invalid volume: volume 45c7792e-0f33-48b3-8a50-09b9f19b1e53 is already attached to instances: bb6e8c47-3155-423c-ac27-8e71fc56bbce {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:54:06.629141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-724b605a-cdf8-4e55-8b75-060bdd5a8817 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.164053 Sep 16 03:54:06.629141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 387/763] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:54:06 2022] POST /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments => generated 174 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:54:06.693206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:06.693704 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:06.699943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:06.700426 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:06.701037 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:06.701909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:06.702358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:06.702770 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:06.842440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lazy-loading 'services' on Instance uuid bb6e8c47-3155-423c-ac27-8e71fc56bbce {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:54:07.044164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:07.044164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] [instance: 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:07.058626 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:07.059410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:07.066850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:07.066850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:07.066850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:07.066850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:07.081412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] HTTP exception thrown: Instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d could not be found. Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Request method failure captured: Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d HTTP/1.1 Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IQJXyFJdHaMqBjeHrrX6Vc1xzZgD1ImELyXYJrUZwdAsqBKD1-4JJwShHN6JJiLxATqXwbGbUt4LTiPZxdSHBtKReRq2iPr19u7dHdT0PEwFAbTNlt9KE6AsRMQTcqEFePru42CEaC430wnwaGuQ5QX4fLiSO4iDxqHDBTRWlT8Yg Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:54:07.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ac97d1487c024a68b8ad933d882bb456"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ac97d1487c024a68b8ad933d882bb456"}]}] Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: ac97d1487c024a68b8ad933d882bb456 Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2121549549 Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: a6b29b9086f64ea7a7990572567642f7 Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2121549549-project Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d could not be found. Sep 16 03:54:07.084707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '3ea00b9d-1f8f-4428-98f7-9d66fd079c6d'} Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d could not be found. Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:54:07.085528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d could not be found. Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d could not be found. Sep 16 03:54:07.086987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:07.088214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] Returning 404 to user: Instance 3ea00b9d-1f8f-4428-98f7-9d66fd079c6d could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:54:07.088214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bcf7da96-6a02-4b3f-a1f2-7a6d9622b2e8 tempest-ServerRescueNegativeTestJSON-2121549549 tempest-ServerRescueNegativeTestJSON-2121549549-project] 10.222.0.49 "GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d" status: 404 len: 111 microversion: 2.1 time: 0.052827 Sep 16 03:54:07.088214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 388/764] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:07 2022] GET /compute/v2.1/servers/3ea00b9d-1f8f-4428-98f7-9d66fd079c6d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 03:54:07.106325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5842913a-9400-4fc7-b27e-1bd4984b40b1 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments/45c7792e-0f33-48b3-8a50-09b9f19b1e53" status: 202 len: 0 microversion: 2.1 time: 0.416090 Sep 16 03:54:07.112297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 377/765] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:54:06 2022] DELETE /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments/45c7792e-0f33-48b3-8a50-09b9f19b1e53 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:54:07.121595 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:07.124133 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:07.131881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:07.132742 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:07.133420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:07.134526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:07.135248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:07.136213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:07.199469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a5eeb373-118d-4e50-b53f-b9085fc3aded tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066470 Sep 16 03:54:07.199469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 389/766] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:54:07 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:08.204994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:08.207573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:08.213974 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:08.214602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:08.215242 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:08.216136 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:08.216588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:08.217195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:08.250235 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0df1edea-ec7a-4dd6-a168-0f5d078318d4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050304 Sep 16 03:54:08.255062 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 378/767] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:54:08 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:09.262515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:09.265680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:09.272464 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:09.272955 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:09.273394 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:09.274102 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:09.274586 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:09.275045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:09.307327 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-42387fbd-e47f-467f-a5b0-a16269cdd8db tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049297 Sep 16 03:54:09.308526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 390/768] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:54:09 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 03:54:09.403541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:09.404061 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:09.412392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:09.413794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:09.414501 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:09.416689 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:09.418007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:09.418785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:09.490254 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:54:09.783365 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:09.950437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ced0c7df-93ae-4d9e-b97f-548ea0dd2f77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 204 len: 0 microversion: 2.1 time: 0.550221 Sep 16 03:54:09.959809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 379/769] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:54:09 2022] DELETE /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:54:09.968248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:09.969165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:09.980687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:09.981536 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:09.982191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:09.983173 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:09.983839 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:09.984495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:10.224496 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:10.233481 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-74cb49e4-3e53-4849-8a5d-dc266e175aff tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1681 microversion: 2.1 time: 0.269107 Sep 16 03:54:10.234067 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 391/770] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:09 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1681 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:11.258535 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:11.259269 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:11.266375 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:11.266867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:11.267327 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:11.268030 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:11.268484 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:11.268904 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:11.518762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:11.528815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-11757541-d124-4153-a9c9-b26d49713405 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1681 microversion: 2.1 time: 0.274493 Sep 16 03:54:11.529682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 380/771] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:11 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:12.555176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:12.555811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:12.566823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:12.568788 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:12.574166 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:12.575953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:12.578458 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:12.580197 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:12.795393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:12.805345 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1740d604-c4fa-40de-9b9f-22b4f2a93fab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1681 microversion: 2.1 time: 0.254221 Sep 16 03:54:12.805925 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 392/772] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:12 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:13.405917 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-d152e388-c7e5-4a2a-94d7-f7d7310d1d3e req-4ed3f55d-5204-48ad-a220-43595f54c2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6e8c47-3155-423c-ac27-8e71fc56bbce", "name": "network-vif-deleted", "tag": "7435ce50-992e-4f86-a4f8-fd731af0e104"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:13.432507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d152e388-c7e5-4a2a-94d7-f7d7310d1d3e req-4ed3f55d-5204-48ad-a220-43595f54c2de service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:13.433366 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d152e388-c7e5-4a2a-94d7-f7d7310d1d3e req-4ed3f55d-5204-48ad-a220-43595f54c2de service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:13.434757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d152e388-c7e5-4a2a-94d7-f7d7310d1d3e req-4ed3f55d-5204-48ad-a220-43595f54c2de service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:13.461695 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-d152e388-c7e5-4a2a-94d7-f7d7310d1d3e req-4ed3f55d-5204-48ad-a220-43595f54c2de service nova] Creating event network-vif-deleted:7435ce50-992e-4f86-a4f8-fd731af0e104 for instance bb6e8c47-3155-423c-ac27-8e71fc56bbce on hv-cinder-85799 Sep 16 03:54:13.482311 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-d152e388-c7e5-4a2a-94d7-f7d7310d1d3e req-4ed3f55d-5204-48ad-a220-43595f54c2de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081551 Sep 16 03:54:13.483553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 381/773] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:13.830124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:13.831070 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:13.842314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:13.849867 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:13.849867 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:13.849867 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:13.849867 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:13.850405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:13.925213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:13.942179 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2fc5fa58-f853-4b28-b863-999adf51ff1f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1326 microversion: 2.1 time: 0.116303 Sep 16 03:54:13.943446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 393/774] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:13 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:14.971465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:14.972170 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:14.989165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:14.990073 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:14.990671 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:14.992011 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:14.992465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:14.993257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:15.044766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:15.045410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:15.060640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:15.061237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:15.066768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:15.066936 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:15.067047 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:15.067047 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:15.067047 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:15.067381 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:15.067743 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:15.068193 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lazy-loading 'fault' on Instance uuid bb6e8c47-3155-423c-ac27-8e71fc56bbce {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:54:15.142894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-990c2d4a-653a-40bf-8b12-e7a63774455b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/ips" status: 200 len: 150 microversion: 2.20 time: 0.102442 Sep 16 03:54:15.145222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 394/775] 10.222.0.49 () {60 vars in 1289 bytes} [Fri Sep 16 03:54:15 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/ips => generated 150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 03:54:15.148244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:15.159127 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b4b3fe0d-175d-481e-ad40-24db895de551 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 200 len: 1331 microversion: 2.1 time: 0.195020 Sep 16 03:54:15.170535 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 382/776] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:14 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 1331 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:16.195121 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:16.195848 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:16.198585 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:16.203808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:16.204639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:16.205147 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:16.205929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:16.206488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:16.208180 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:16.223989 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce HTTP/1.1 Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:54:16.226273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:54:16.227828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'bb6e8c47-3155-423c-ac27-8e71fc56bbce'} Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:54:16.228704 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:54:16.229960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:54:16.231608 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:54:16.231608 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-406cdbd3-ce6e-480e-b949-f8fd92c3d877 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 404 len: 111 microversion: 2.1 time: 0.037361 Sep 16 03:54:16.231608 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 395/777] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:16 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:54:16.236591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7d3d5026-5e03-405e-9b9f-b3d1a04f439e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '.version_select at 0x7fba7c5ec550>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:16.377473 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7d3d5026-5e03-405e-9b9f-b3d1a04f439e tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-688420617" status: 202 len: 0 microversion: 2.1 time: 0.145158 Sep 16 03:54:16.379207 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 383/778] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 16 03:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-688420617 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:54:17.345534 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7ab98355-1d8f-4ae8-9bdc-e426c7475ad2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: .version_select at 0x7fba7c625280>, body: {"keypair": {"name": "tempest-keypair-162716386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyFT+RhHsk+uQr/IY137yVN1YBsdBWomRAbekbxhR0aKVNiw0I83tfiG8K4CErwCrOA5dcHhF45v+xdi8tso5tyemvLM+CZ40wtdDQv9RQLMBHtsC70Ar1r6Mya0wH98A=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:17.385267 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-7ab98355-1d8f-4ae8-9bdc-e426c7475ad2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:54:17.395178 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-7ab98355-1d8f-4ae8-9bdc-e426c7475ad2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for user ff7df9be8475405eba924b59a7bd6bb0 and project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:54:17.470225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7ab98355-1d8f-4ae8-9bdc-e426c7475ad2 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128670 Sep 16 03:54:17.474551 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 396/779] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:54:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:17.481361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:17.482541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:17.491370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:17.491955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:17.492768 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:17.493945 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:17.494620 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:17.495873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:17.536991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lazy-loading 'flavor' on Instance uuid 2263def2-54ff-4255-a751-2bdb7e32db67 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:54:17.689133 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:18.512386 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e3095363-3b42-49f4-85b9-167af427306a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/action" status: 202 len: 0 microversion: 2.20 time: 1.035299 Sep 16 03:54:18.517325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 384/780] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Sep 16 03:54:17 2022] POST /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:54:18.529218 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:18.529904 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:18.546124 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:18.547443 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:18.552827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:18.552827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:18.552827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:18.552827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:18.579850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:18.760662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:18.776816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:18.778764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:18.780300 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-02a73e08-8c76-44dc-8df7-663246b234e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.259871 Sep 16 03:54:18.781401 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 397/781] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:18 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:19.815393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:19.816122 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:19.828250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:19.828766 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:19.829433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:19.830539 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:19.831389 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:19.832186 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:20.078779 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:20.088991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:20.090845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:20.092222 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f1b7e31d-9f1e-4188-8677-9328b1fad4dd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.282344 Sep 16 03:54:20.092812 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 385/782] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:19 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:21.119453 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:21.120647 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:21.136081 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:21.136816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:21.137523 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:21.138599 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:21.139373 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:21.139993 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:21.360954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:21.361678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:21.364783 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:21.365989 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0f81e2c5-d637-4416-ab13-a0fbc1b49976 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.251658 Sep 16 03:54:21.366709 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 398/783] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:21 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:21.472704 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-220949735", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ff8c520-12d3-47e5-b499-6dbd6e9a131a"}], "security_groups": [{"name": "tempest-securitygroup--872854830"}], "key_name": "tempest-keypair-162716386", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:21.613543 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] validate_networks() for [('4ff8c520-12d3-47e5-b499-6dbd6e9a131a', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:54:22.065385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:54:22.066365 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:54:22.067082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:54:22.067807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:54:22.068378 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:54:22.077925 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:22.078439 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:22.078874 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:22.079621 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:22.080073 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:22.080524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:22.102018 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:54:22.106129 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Getting quotas for user ff7df9be8475405eba924b59a7bd6bb0 and project 8ee4a40c6c264553a14e0eff367da4a0. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:54:22.121112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:54:22.123819 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:54:22.397799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:22.398701 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:22.406475 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:22.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:22.407424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:22.408239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:22.408713 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:22.409329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:22.525050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-45df1b71-0b12-4041-9709-69aeeac79309 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.055787 Sep 16 03:54:22.526461 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 386/784] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:54:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:54:22.544101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0a52bae4-bfa0-4058-8807-f3d5c89c6b77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:22.546638 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0a52bae4-bfa0-4058-8807-f3d5c89c6b77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:22.661855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0a52bae4-bfa0-4058-8807-f3d5c89c6b77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:22.672507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0a52bae4-bfa0-4058-8807-f3d5c89c6b77 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1240 microversion: 2.1 time: 0.138201 Sep 16 03:54:22.673277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 387/785] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:22 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1240 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:22.689650 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:22.699862 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:22.707033 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:22.708610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6fa05a4f-6919-4f49-8f9d-943da8e3f295 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.316132 Sep 16 03:54:22.709166 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 399/786] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:22 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:23.698444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:23.699084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:23.707058 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:23.707551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:23.707992 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:23.708688 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:23.709224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:23.709727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:23.736781 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:23.737562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:23.745405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:23.745903 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:23.746345 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:23.747099 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:23.747659 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:23.748131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:23.778543 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:23.786846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-96262b6f-da05-460c-8925-be7a3cd9bb86 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1244 microversion: 2.1 time: 0.092562 Sep 16 03:54:23.787444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 388/787] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:23 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:23.890856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:23.899764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:23.901166 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:23.902329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-606d5d94-0fb6-4b8a-8ef8-8464def016bc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.170197 Sep 16 03:54:23.902875 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 400/788] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:23 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:24.810534 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:24.811184 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:24.817987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:24.818476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:24.818927 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:24.819629 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:24.820271 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:24.820863 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:24.896087 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:24.904591 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8e0cfd7b-d765-4e96-b3d7-b6066aa96f04 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1292 microversion: 2.1 time: 0.098774 Sep 16 03:54:24.911090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 389/789] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:24 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:24.930749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:24.931845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:24.938769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:24.939720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:24.940355 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:24.941545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:24.942210 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:24.942827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:25.100837 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:25.109150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:25.111897 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:25.111897 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6b861cc6-da81-4e74-b9dd-7cb0a22a6002 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.185467 Sep 16 03:54:25.130199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 401/790] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:24 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:25.929001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:25.929627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:25.939685 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:25.942938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:25.945870 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:25.946999 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:25.947320 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:25.947757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:26.047818 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:26.058069 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0242650a-dcaa-486b-b040-53f862b3e6ab tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1300 microversion: 2.1 time: 0.133879 Sep 16 03:54:26.058649 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 390/791] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:25 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:26.157809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:26.157809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:26.157809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:26.157809 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:26.158615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:26.158615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:26.158615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:26.158615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:26.326845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:26.339578 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:26.340822 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:26.341991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c1456bdc-9bca-4c85-9173-59e668a91c1e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.208264 Sep 16 03:54:26.342876 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 402/792] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:26 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:27.085323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:27.087213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:27.102970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:27.103720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:27.104355 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:27.105225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:27.106786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:27.111514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:27.319040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:27.328256 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7ac7f706-8d8a-4e89-a0b1-d63d73edc896 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.250491 Sep 16 03:54:27.344954 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 391/793] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:27 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:27.369548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:27.378355 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:27.385372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:27.387808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:27.388491 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:27.390415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:27.391089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:27.392657 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:27.421687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:27.551488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:27.560474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:27.562019 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:27.563319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9e112740-dfe4-4932-8e05-4218a2648363 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.197679 Sep 16 03:54:27.564038 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 403/794] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:27 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:28.354686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:28.355409 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:28.366723 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:28.367249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:28.367688 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:28.368396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:28.368851 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:28.369488 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:28.518070 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-bf2b7729-2706-4c04-aeb6-9388d28789b1 req-128b4ad8-6c36-4e6d-a833-c927c312cfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0584f7f8-cc04-4019-9971-a0e59ee918f0", "tag": "59cf9322-5f98-4a80-b3ba-193361cc8857"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:28.536724 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bf2b7729-2706-4c04-aeb6-9388d28789b1 req-128b4ad8-6c36-4e6d-a833-c927c312cfa6 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:28.537564 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bf2b7729-2706-4c04-aeb6-9388d28789b1 req-128b4ad8-6c36-4e6d-a833-c927c312cfa6 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:28.538246 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bf2b7729-2706-4c04-aeb6-9388d28789b1 req-128b4ad8-6c36-4e6d-a833-c927c312cfa6 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:28.554540 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-bf2b7729-2706-4c04-aeb6-9388d28789b1 req-128b4ad8-6c36-4e6d-a833-c927c312cfa6 service nova] Creating event network-changed:59cf9322-5f98-4a80-b3ba-193361cc8857 for instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 on hv-cinder-85799 Sep 16 03:54:28.561141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-bf2b7729-2706-4c04-aeb6-9388d28789b1 req-128b4ad8-6c36-4e6d-a833-c927c312cfa6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046646 Sep 16 03:54:28.562402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 404/795] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:28.589667 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:28.590644 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:28.597296 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:28.598161 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:28.599246 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:28.599977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:28.600440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:28.601484 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:28.668330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:28.680053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-19b7ef7b-269e-4634-89b7-0f5f2870a380 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.330845 Sep 16 03:54:28.680757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 392/796] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:28 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:28.748398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:28.757534 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:28.759055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:28.760227 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-473c210d-6907-4b39-b543-a4d1939ef97b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.174905 Sep 16 03:54:28.760785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 405/797] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:28 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:29.152428 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4a005ceb-0449-46bd-a10e-1439645be984 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Action: 'create', calling method: .version_select at 0x7fba7c566700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-779987514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNB6814w/cO0TFvRTOPiQomF4XN0aTd08Vx2LXPM8ycCcqkd2eIhrZZQ0hPU2JuOWUpq9pHhirsDzDVDamAF/Zxw5/zhWVHkm3gie/wXHdwcDlQ/zy6Ao3DoxTT3VwyLGg=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:29.169193 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-4a005ceb-0449-46bd-a10e-1439645be984 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Getting quotas for project c705c2f92c1646dba9c11aa6000166bc. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:54:29.173034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-4a005ceb-0449-46bd-a10e-1439645be984 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Getting quotas for user 269dbbd6d926496d8c5c704832de5763 and project c705c2f92c1646dba9c11aa6000166bc. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:54:29.263800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4a005ceb-0449-46bd-a10e-1439645be984 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.115103 Sep 16 03:54:29.264410 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 393/798] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:54:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:29.433544 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1638493205", "imageRef": "2507f9f0-e140-4c8c-aa95-b23fb4ae8d8a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-779987514", "networks": [{"uuid": "9e27b901-fe49-4a95-bac7-28ae58e74a1c"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:29.487307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] validate_networks() for [('9e27b901-fe49-4a95-bac7-28ae58e74a1c', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:54:29.703476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:29.704091 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:29.710235 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:29.710773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:29.711330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:29.712392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:29.712942 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:29.713460 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:29.853958 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:29.861851 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-99711a15-fd16-4221-bdb1-5ec4e3a1162a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.162727 Sep 16 03:54:29.862412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 394/799] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:29 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:54:29.869498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:29.869498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:29.877980 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:29.878526 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:29.878986 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:29.879679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:29.880137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:29.880554 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:29.976126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:54:29.976565 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:54:29.977229 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:54:29.977620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:54:29.978516 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:54:29.988391 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:29.988950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:29.989284 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:29.990115 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:29.990656 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:29.991097 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:30.010642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Getting quotas for project c705c2f92c1646dba9c11aa6000166bc. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:54:30.015190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Getting quotas for user 269dbbd6d926496d8c5c704832de5763 and project c705c2f92c1646dba9c11aa6000166bc. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:54:30.021440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:30.028538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:54:30.031116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2507f9f0-e140-4c8c-aa95-b23fb4ae8d8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:54:30.031287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:30.032646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:30.033810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f82bda50-e5b3-499d-86ae-8604d6466160 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.169889 Sep 16 03:54:30.034364 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 395/800] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:29 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:30.178036 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d75197f6-9ad2-451d-97f6-8fb4fd64a5ea tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748786 Sep 16 03:54:30.178671 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 406/801] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:54:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:54:30.199623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-236bceac-f5f6-488b-9172-4f20478ebf44 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:30.199623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-236bceac-f5f6-488b-9172-4f20478ebf44 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:30.248886 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-236bceac-f5f6-488b-9172-4f20478ebf44 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:30.256679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-236bceac-f5f6-488b-9172-4f20478ebf44 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1258 microversion: 2.1 time: 0.070283 Sep 16 03:54:30.257111 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 396/802] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:30 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:30.886038 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:30.887708 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:30.893447 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:30.894471 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:30.894901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:30.895602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:30.896048 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:30.896466 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:31.026643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:31.034351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-01279820-d144-47ea-a4a5-2ebc7ad64708 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.153018 Sep 16 03:54:31.035198 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 407/803] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:30 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:31.059745 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:31.060403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:31.068042 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:31.068522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:31.068955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:31.069714 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:31.070161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:31.070807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:31.205682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:31.214931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:31.216444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:31.217771 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d3743cf8-207a-49f9-bb72-234eb2e2371a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.162131 Sep 16 03:54:31.218819 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 397/804] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:31 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:31.280635 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-31c70fc6-5287-4410-a3d9-88196b3a2790 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:31.281241 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-31c70fc6-5287-4410-a3d9-88196b3a2790 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:31.337036 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-31c70fc6-5287-4410-a3d9-88196b3a2790 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:31.344095 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-31c70fc6-5287-4410-a3d9-88196b3a2790 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1258 microversion: 2.1 time: 0.067394 Sep 16 03:54:31.344667 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 408/805] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:31 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:32.060093 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:32.060727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:32.067252 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:32.067755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:32.068190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:32.068873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:32.069325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:32.069757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:32.091211 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:32.204016 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:32.212206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5f0c11ab-6c8a-4414-983a-ece625fb38b7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.156307 Sep 16 03:54:32.213342 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 398/806] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:32 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:32.243141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:32.243788 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:32.250821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:32.251486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:32.251927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:32.252638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:32.253094 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:32.253617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:32.366792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:32.367435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:32.373247 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:32.373931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:32.374366 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:32.375088 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:32.375538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:32.375963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:32.390769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:32.399801 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:32.401316 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:32.402482 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ce21ae74-caec-4330-be06-3d8783302d40 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.163305 Sep 16 03:54:32.403051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 409/807] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:32 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:32.444466 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:32.452585 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fc6ca161-9d14-4917-8222-c862bb71deaf tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1310 microversion: 2.1 time: 0.089945 Sep 16 03:54:32.459342 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 399/808] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:32 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:54:33.236230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:33.236942 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:33.243762 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:33.244401 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:33.244661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:33.245344 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:33.245790 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:33.246209 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:33.389887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:33.400408 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c4d4aba-de21-4205-86a8-43d315ba5c85 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.166586 Sep 16 03:54:33.400408 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 410/809] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:33 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:33.431019 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:33.432645 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:33.439504 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:33.440450 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:33.440952 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:33.441892 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:33.442481 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:33.442979 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:33.615187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-e59eb053-f32e-4686-b7a9-e930c3f14246 req-9a3c93f1-ebba-4f3e-b9e3-7bba57218deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0584f7f8-cc04-4019-9971-a0e59ee918f0", "name": "network-vif-plugged", "status": "completed", "tag": "59cf9322-5f98-4a80-b3ba-193361cc8857"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:33.625315 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e59eb053-f32e-4686-b7a9-e930c3f14246 req-9a3c93f1-ebba-4f3e-b9e3-7bba57218deb service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:33.625798 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e59eb053-f32e-4686-b7a9-e930c3f14246 req-9a3c93f1-ebba-4f3e-b9e3-7bba57218deb service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:33.626885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e59eb053-f32e-4686-b7a9-e930c3f14246 req-9a3c93f1-ebba-4f3e-b9e3-7bba57218deb service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:33.640764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-e59eb053-f32e-4686-b7a9-e930c3f14246 req-9a3c93f1-ebba-4f3e-b9e3-7bba57218deb service nova] Creating event network-vif-plugged:59cf9322-5f98-4a80-b3ba-193361cc8857 for instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 on hv-cinder-85799 Sep 16 03:54:33.646755 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-e59eb053-f32e-4686-b7a9-e930c3f14246 req-9a3c93f1-ebba-4f3e-b9e3-7bba57218deb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198207 Sep 16 03:54:33.647738 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 411/810] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:33.653012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:33.653731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:33.672599 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:33.673328 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:33.673936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:33.674359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:33.675116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:33.675726 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:33.676303 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:33.686594 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:33.690722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:33.692353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-779556a6-3b9c-4a3b-8d43-ba75b8b1ea75 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.266235 Sep 16 03:54:33.694090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 400/811] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:33 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:33.753309 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:33.764359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-83c46679-0fef-4a3b-9c55-ddabe5ab36b1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1316 microversion: 2.1 time: 0.112369 Sep 16 03:54:33.764359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 412/812] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:33 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:34.424091 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:34.424707 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:34.433988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:34.438672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:34.438672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:34.438672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:34.438672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:34.439325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:34.602650 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:34.610598 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c657d51c-efc8-41bd-adcd-0ef423b1f71f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.190350 Sep 16 03:54:34.611882 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 401/813] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:34 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:34.723887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:34.724510 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:34.731834 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:34.732322 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:34.732881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:34.733873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:34.734426 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:34.734852 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:34.790085 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:34.791157 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:34.806289 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:34.807317 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:34.807935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:34.808915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:34.809698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:34.810249 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:34.998589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:35.019440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:35.033118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:35.035234 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d3f1bf23-3260-4987-95d8-5cd4f115a9d7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.315920 Sep 16 03:54:35.039331 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:35.039754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 413/814] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:34 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:35.051436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-05dba665-f18d-4bfc-b116-40588cf9c0f4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.264902 Sep 16 03:54:35.052561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 402/815] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:34 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:54:35.641680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:35.643178 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:35.668890 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:35.669858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:35.670580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:35.671607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:35.672380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:35.672964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:35.886598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:35.905305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d6c52e8d-1990-4f98-80e0-6b9c2ca727c7 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.270015 Sep 16 03:54:35.905900 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 414/816] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:35 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:36.069501 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:36.071605 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:36.078358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:36.079126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:36.090769 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:36.093244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:36.094149 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:36.094984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:36.095713 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:36.096341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:36.100127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:36.100892 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:36.101330 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:36.102058 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:36.102509 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:36.102950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:36.303726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:36.313292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:36.315220 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:36.317294 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-84631d6a-20ff-4c2b-ab41-695d51975eb5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.254778 Sep 16 03:54:36.318490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 403/817] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:36 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:36.355136 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:36.369989 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2a1bb3e6-78e2-428a-a856-62858be538b0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.295601 Sep 16 03:54:36.371542 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 415/818] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:36 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:36.930160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:36.931224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:36.938150 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:36.938952 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:36.939627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:36.940403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:36.940963 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:36.941445 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:36.946159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:37.120719 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:37.129348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a8bbd564-446c-43f6-9aa8-cf5fa0804295 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.203438 Sep 16 03:54:37.143609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 404/819] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:36 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:37.342786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:37.343529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:37.356596 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-975be109-2292-41de-b8fe-17d5accc201c req-1fa48d47-c508-4e12-9224-876a6681c912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2263def2-54ff-4255-a751-2bdb7e32db67", "name": "network-vif-plugged", "status": "completed", "tag": "68bc6748-c4d5-4935-8d58-9b9bd27239ad"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:37.367351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:37.373062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:37.373062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:37.373062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:37.373062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:37.373509 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:37.380564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-975be109-2292-41de-b8fe-17d5accc201c req-1fa48d47-c508-4e12-9224-876a6681c912 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:37.381070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-975be109-2292-41de-b8fe-17d5accc201c req-1fa48d47-c508-4e12-9224-876a6681c912 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:37.381646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-975be109-2292-41de-b8fe-17d5accc201c req-1fa48d47-c508-4e12-9224-876a6681c912 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:37.404842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-975be109-2292-41de-b8fe-17d5accc201c req-1fa48d47-c508-4e12-9224-876a6681c912 service nova] Creating event network-vif-plugged:68bc6748-c4d5-4935-8d58-9b9bd27239ad for instance 2263def2-54ff-4255-a751-2bdb7e32db67 on hv-cinder-85799 Sep 16 03:54:37.414728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-975be109-2292-41de-b8fe-17d5accc201c req-1fa48d47-c508-4e12-9224-876a6681c912 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069809 Sep 16 03:54:37.415366 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 405/820] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:54:37.429424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:37.430279 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:37.437531 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:37.439055 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:37.439623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:37.440559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:37.442053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:37.442723 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:37.542603 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:37.571768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:37.573404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:37.574625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2c391a42-52bf-49d1-b352-0a64c7bb534e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.235767 Sep 16 03:54:37.575235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 416/821] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:37 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:37.638043 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:37.646633 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-83efc481-0362-4283-9c56-14903ad102a3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.222893 Sep 16 03:54:37.647246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 406/822] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:37 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:38.152958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:38.154069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:38.161724 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:38.162486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:38.162652 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:38.163400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:38.163856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:38.164282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:38.167237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:38.332030 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:38.335341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3569f433-cc4e-4ad2-a653-8659dff04462 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.186094 Sep 16 03:54:38.335967 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 417/823] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:38 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:38.608853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:38.610508 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:38.618798 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:38.619500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:38.620096 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:38.620971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:38.621622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:38.622307 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:38.671489 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:38.678173 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:38.680994 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:38.682231 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:38.683286 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:38.684270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:38.684801 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:38.685736 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:38.822672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:38.835121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:38.847611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:38.852649 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:38.856697 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9966be94-6a20-46a5-93e3-86641defe1c2 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.244533 Sep 16 03:54:38.878467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-54bcf128-c0e7-4cb0-9ea6-6a9502834db1 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.209372 Sep 16 03:54:38.879082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 407/824] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:38 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:38.879913 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 418/825] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:38 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:54:39.378717 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:39.382098 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:39.398926 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:39.399835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:39.402397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:39.403482 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:39.404163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:39.404598 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:39.586338 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:39.594611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-49308086-19e1-44f1-8932-38d70cc9bc35 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.234276 Sep 16 03:54:39.595454 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 408/826] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:39 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:39.890585 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:39.891495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:39.903434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:39.903744 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:39.904283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:39.904750 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:39.905075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:39.906031 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:39.906700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:39.907457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:39.912647 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:39.913144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:39.913587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:39.914287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:39.914741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:39.917257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:39.999713 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:40.102282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:40.104496 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:40.132906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c62c059c-aa0d-4098-83a4-953abe7f0d25 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.211443 Sep 16 03:54:40.132906 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 409/827] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:39 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:40.133202 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:40.133202 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:40.133202 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e0a36bcc-b36d-4bea-abb0-799f3e98c95f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.229230 Sep 16 03:54:40.133517 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 419/828] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:39 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:40.619759 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:40.620855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:40.640188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=14 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:40.640971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:40.642500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:40.643142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:40.643586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:40.644296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:40.644750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:40.645173 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:40.790447 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:40.812836 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e569f6ef-3600-472e-b344-2390bee119cb tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.182941 Sep 16 03:54:40.812836 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 410/829] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:40 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:41.135920 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:41.138178 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:41.145639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:41.146146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:41.146841 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:41.147228 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:41.147628 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:41.147958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:41.148465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:41.148835 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:41.172215 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:41.172712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:41.173153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:41.174158 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:41.174621 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:41.175076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:41.318161 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:41.335911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-28fdd3f0-e0c5-42ce-bfc4-dad71f3afc15 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.203350 Sep 16 03:54:41.338191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 420/830] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:41 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:41.394490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:41.404608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:41.406040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:41.407263 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8ea6240f-eaa7-4c16-b271-e08e379aeedb tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.267686 Sep 16 03:54:41.408325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 411/831] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:41 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:41.837851 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:41.839519 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:41.841676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=8 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:41.846602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:41.847186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:41.847690 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:41.848574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:41.850036 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:41.850185 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:42.008371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:42.017558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-14466e0a-ab20-46c3-8194-cf3547733cfd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.188111 Sep 16 03:54:42.018122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 421/832] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:41 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:42.360676 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:42.361322 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:42.369446 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:42.370897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:42.370897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:42.371397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:42.371853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:42.372272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:42.434399 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:42.435065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:42.444008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:42.444495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:42.444927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:42.446175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:42.446647 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:42.447332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:42.507555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:42.517921 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-845bd311-4b31-4ef4-997b-9e13d3dabbc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.161583 Sep 16 03:54:42.530931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 412/833] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:42 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:42.583733 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:42.591813 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:42.595957 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:42.595957 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-caf936d4-264c-4a53-bfa0-9d83d266816b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.164362 Sep 16 03:54:42.595957 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 422/834] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:42 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:43.041789 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:43.042406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:43.048243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:43.048711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:43.049146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:43.049828 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:43.050291 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:43.050693 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:43.281132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:43.289405 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-408b0d50-4f42-48f2-8e8b-33a962a0baa4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.251843 Sep 16 03:54:43.302932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 413/835] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:43 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:43.541937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:43.542467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:43.549027 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:43.549494 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:43.550123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:43.550814 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:43.551291 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:43.552215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:43.572048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0b788b45-68f5-46f7-aa20-a8fdc6cc284b req-02aacc3b-ebb2-4e18-a6b1-9971d57a5df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cedd5c-2825-4c90-81bd-9300e1db80c9", "tag": "29237f39-1732-4b4a-81d4-300640dd2721"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:43.583545 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b788b45-68f5-46f7-aa20-a8fdc6cc284b req-02aacc3b-ebb2-4e18-a6b1-9971d57a5df0 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:43.584026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b788b45-68f5-46f7-aa20-a8fdc6cc284b req-02aacc3b-ebb2-4e18-a6b1-9971d57a5df0 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:43.584459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b788b45-68f5-46f7-aa20-a8fdc6cc284b req-02aacc3b-ebb2-4e18-a6b1-9971d57a5df0 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:43.596006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0b788b45-68f5-46f7-aa20-a8fdc6cc284b req-02aacc3b-ebb2-4e18-a6b1-9971d57a5df0 service nova] Creating event network-changed:29237f39-1732-4b4a-81d4-300640dd2721 for instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 on hv-cinder-85799 Sep 16 03:54:43.601856 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0b788b45-68f5-46f7-aa20-a8fdc6cc284b req-02aacc3b-ebb2-4e18-a6b1-9971d57a5df0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035655 Sep 16 03:54:43.602634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 414/836] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:43.620504 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:43.621293 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:43.627540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:43.635036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:43.635036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:43.635036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:43.635036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:43.635475 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:43.707147 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:43.711229 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9c93bbcb-9b02-4ef6-b65d-cb2804f31375 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.173237 Sep 16 03:54:43.711793 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 423/837] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:43 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:43.864153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:43.872941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:43.874406 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:43.875590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a4f92cbc-1ad3-44d0-bc19-15db4cd525dc tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.259368 Sep 16 03:54:43.876143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 415/838] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:43 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:44.314761 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:44.315488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:44.323224 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:44.323747 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:44.325256 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:44.325256 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:44.325569 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:44.325912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:44.459474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:44.467524 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1cc4a9fd-08e2-45db-a1cb-c1ffd7e69ea5 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1365 microversion: 2.1 time: 0.157466 Sep 16 03:54:44.468287 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 424/839] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:44 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:44.733614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:44.738891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:44.740819 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:44.741300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:44.741731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:44.742412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:44.742856 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:44.743300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:44.901258 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:44.901849 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:44.908287 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:44.908763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:44.909192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:44.909877 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:44.910378 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:44.911554 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:44.949288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:44.956976 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3b522908-30f9-45b5-9022-b0184a717514 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.227089 Sep 16 03:54:44.966942 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 416/840] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:44 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:45.044928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:45.053565 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:45.061665 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:45.061665 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0fbf32fb-6a39-45fb-9350-d291aaf7916a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.159184 Sep 16 03:54:45.061665 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 425/841] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:44 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:45.499821 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:45.500420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:45.506808 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:45.507418 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:45.507846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:45.508520 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:45.508968 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:45.509379 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:45.636721 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:45.644418 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bc664a26-24fd-4d8b-868a-91d72b32ad8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1555 microversion: 2.1 time: 0.148627 Sep 16 03:54:45.647261 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 417/842] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:45 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:45.667034 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:45.667533 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:45.673491 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:45.673968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:45.674409 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:45.675134 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:45.675590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:45.676012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:45.758098 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5d9c4837-c3a5-4cc5-b4d8-8b44b21e71de tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094906 Sep 16 03:54:45.758690 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 426/843] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 16 03:54:45 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:45.980899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:45.981552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:45.988176 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:45.988667 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:45.989203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:45.990538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:45.991026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:45.991454 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:46.086854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:46.088104 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:46.094346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:46.095256 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:46.095881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:46.096572 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:46.097018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:46.097432 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:46.137132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:46.144997 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4b71d175-7db8-4989-b6b2-b898e8501a63 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.167965 Sep 16 03:54:46.146225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 418/844] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:45 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:46.298494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:46.299021 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:46.305027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:46.305521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:46.305964 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:46.306689 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:46.307445 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:46.307877 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:46.334827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8b1ef9b1-4d57-409f-923a-c8ae25be0040 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/ips" status: 200 len: 146 microversion: 2.1 time: 0.040470 Sep 16 03:54:46.335442 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 419/845] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:54:46 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:54:46.338844 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:46.349425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:46.350858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:46.352079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-313e4f5b-6a6f-4e22-a417-05c5ecfbb6e8 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.270291 Sep 16 03:54:46.352790 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 427/846] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:46 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:47.105942 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-210b7db8-c203-460e-9dff-5d30a37126b1 req-9c16583e-e73d-4589-996b-164b3a86d12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0584f7f8-cc04-4019-9971-a0e59ee918f0", "tag": "59cf9322-5f98-4a80-b3ba-193361cc8857"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:47.115811 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-210b7db8-c203-460e-9dff-5d30a37126b1 req-9c16583e-e73d-4589-996b-164b3a86d12f service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:47.120381 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-210b7db8-c203-460e-9dff-5d30a37126b1 req-9c16583e-e73d-4589-996b-164b3a86d12f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:47.120381 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-210b7db8-c203-460e-9dff-5d30a37126b1 req-9c16583e-e73d-4589-996b-164b3a86d12f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:47.128123 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-210b7db8-c203-460e-9dff-5d30a37126b1 req-9c16583e-e73d-4589-996b-164b3a86d12f service nova] Creating event network-changed:59cf9322-5f98-4a80-b3ba-193361cc8857 for instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 on hv-cinder-85799 Sep 16 03:54:47.133262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-210b7db8-c203-460e-9dff-5d30a37126b1 req-9c16583e-e73d-4589-996b-164b3a86d12f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030927 Sep 16 03:54:47.133919 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 420/847] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:47.168894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:47.169530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:47.176246 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:47.177063 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:47.177502 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:47.178228 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:47.178822 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:47.179283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:47.324368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:47.332320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b096f196-418d-4653-b144-fc53e5cc58f3 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.167631 Sep 16 03:54:47.333437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 428/848] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:47 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:47.378163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:47.378994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:47.385969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:47.386525 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:47.386983 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:47.387667 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:47.388112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:47.388529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:47.517192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:47.525482 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:47.526864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:47.528166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c681da10-678f-460c-ae22-936b02715228 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.154291 Sep 16 03:54:47.528728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 421/849] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:47 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:48.357961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:48.358562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:48.365918 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:48.366398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:48.366826 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:48.367581 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:48.368018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:48.368435 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:48.504388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:48.512648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-169fbfc9-cc99-4665-bf46-ca41ce05fb02 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.158549 Sep 16 03:54:48.513210 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 429/850] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:48 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:48.553945 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:48.554561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:48.568789 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:48.569286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:48.569724 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:48.570431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:48.571115 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:48.571546 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:48.717935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:48.726325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:48.727800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:48.728967 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1d46a4ce-0304-4a32-a285-92413fb7344e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1742 microversion: 2.20 time: 0.179173 Sep 16 03:54:48.729801 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 422/851] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:48 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:49.537224 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:49.537776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:49.540140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:49.544831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:49.545313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:49.545747 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:49.546440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:49.546888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:49.547335 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:49.676047 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:49.684123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-11beab70-a64f-4571-bc53-e0d1e67cea06 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.151693 Sep 16 03:54:49.684685 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 430/852] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:49 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:49.757343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:49.757949 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:49.764343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:49.764818 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:49.765248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:49.765918 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:49.766364 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:49.766780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:49.769377 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:49.894838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:49.903016 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:49.904447 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:49.905609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-33203fda-3b6f-4b57-9dec-70c33430ed1a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.152812 Sep 16 03:54:49.906248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 423/853] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:49 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:50.152033 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c145a21-9513-4a3b-b971-b695a8d1b8f6"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:50.154646 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:50.160916 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:50.161492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:50.162397 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:50.163128 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:50.163585 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:50.164248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:50.764282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:50.764282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:50.764282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:50.764282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:50.765343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:50.765343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:50.765343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:50.765343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:50.926044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:50.938513 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10361e13-b711-4c6d-b520-a4b42ba52705 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.235215 Sep 16 03:54:50.939688 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 424/854] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:50 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:54:50.944831 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:50.945648 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:50.953901 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:50.954401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:50.954843 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:50.955696 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:50.956029 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:50.956454 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:51.114371 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:51.123948 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:51.130404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:51.130404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-408c88a7-9c3d-4b7d-aff0-9e6a8c329072 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.185615 Sep 16 03:54:51.130404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 425/855] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:50 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:51.965500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:51.966321 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:51.972646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:51.973134 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:51.974603 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:51.975876 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:51.976563 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:51.977423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:52.214345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:52.224839 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b51e9bb4-c0d7-40d6-ad9b-fabbbb51417a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.263300 Sep 16 03:54:52.227618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 426/856] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:51 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:54:52.231145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:52.232041 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:52.238543 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:52.239920 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:52.240748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:52.241675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:52.242221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:52.242829 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:52.410340 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:52.425351 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:52.427268 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:52.429205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d22c4121-1c07-461d-a814-790db3b0c1f4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.202213 Sep 16 03:54:52.441675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 427/857] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:52 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:52.593806 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-4335db09-c36a-4e9d-8adc-d9521112b995 req-f0c08c40-13f4-4608-bb81-55ee2998e660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cedd5c-2825-4c90-81bd-9300e1db80c9", "name": "network-vif-plugged", "status": "completed", "tag": "29237f39-1732-4b4a-81d4-300640dd2721"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:52.610605 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4335db09-c36a-4e9d-8adc-d9521112b995 req-f0c08c40-13f4-4608-bb81-55ee2998e660 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:52.611393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4335db09-c36a-4e9d-8adc-d9521112b995 req-f0c08c40-13f4-4608-bb81-55ee2998e660 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:52.612017 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4335db09-c36a-4e9d-8adc-d9521112b995 req-f0c08c40-13f4-4608-bb81-55ee2998e660 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:52.625633 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-4335db09-c36a-4e9d-8adc-d9521112b995 req-f0c08c40-13f4-4608-bb81-55ee2998e660 service nova] Creating event network-vif-plugged:29237f39-1732-4b4a-81d4-300640dd2721 for instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 on hv-cinder-85799 Sep 16 03:54:52.631745 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-4335db09-c36a-4e9d-8adc-d9521112b995 req-f0c08c40-13f4-4608-bb81-55ee2998e660 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042968 Sep 16 03:54:52.632657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 428/858] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:52.815361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-320918eb-8c42-4be8-8243-e054479cf1da tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.666835 Sep 16 03:54:52.816005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 431/859] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:54:50 2022] POST /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments => generated 194 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:53.252438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:53.253672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:53.265700 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:53.266105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:53.266542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:53.267354 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:53.268067 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:53.268530 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:53.417442 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:53.425162 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3d8ec12a-e5a3-42a8-8827-22f2bf73241f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.180103 Sep 16 03:54:53.425731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 429/860] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:53 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:53.457081 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:53.458430 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:53.465028 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:53.465504 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:53.465934 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:53.466615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:53.467098 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:53.467520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:53.600246 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:53.602719 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:53.609265 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:53.610707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:53.611914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ff4061d6-7fa2-416b-ab57-0317f4757143 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.159007 Sep 16 03:54:53.612456 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 432/861] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:53 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:54.466237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:54.467221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:54.473168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:54.473981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:54.474343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:54.475082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:54.475538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:54.475964 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:54.637533 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:54.638175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:54.646285 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:54.646668 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:54.647359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:54.648032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:54.648935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:54.649731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:54.650164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:54.661086 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c42c51ea-e3af-47d2-9f96-42b383c8b386 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1358 microversion: 2.1 time: 0.215391 Sep 16 03:54:54.674969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 430/862] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:54 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:54.814846 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:54.827367 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:54.828873 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:54.830238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8de74050-e2fe-41e7-b465-9ede22d609a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.196597 Sep 16 03:54:54.830983 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 433/863] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:54 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:55.692472 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:55.693329 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:55.705800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:55.707407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:55.709669 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:55.710542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:55.711096 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:55.711592 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:55.860740 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:55.861357 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:55.868330 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:55.869060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:55.869826 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:55.870846 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:55.871326 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:55.871974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:55.882204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:55.896299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5ef67dd3-a83a-4667-96a2-186690863dd7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1549 microversion: 2.1 time: 0.208823 Sep 16 03:54:55.897212 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 431/864] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:55 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1549 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:55.927078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:55.927690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:55.934468 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:55.935001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:55.935439 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:55.936141 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:55.936622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:55.937050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:56.027392 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:56.040346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:56.042042 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:56.043486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7293405b-3765-40cb-a496-478a0c6fcf7c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.190861 Sep 16 03:54:56.044581 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 434/865] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:55 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:54:56.102709 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:56.110524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e18f405a-7960-459a-bf54-d512642101fd tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1549 microversion: 2.1 time: 0.188340 Sep 16 03:54:56.111654 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 432/866] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:55 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1549 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:54:56.138111 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:56.143287 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:56.144058 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Searching by: {'deleted': False, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc'} {{(pid=127618) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 03:54:56.151302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:56.156517 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:56.156517 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:56.156517 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:56.156517 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:56.156955 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:56.268010 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.multi_cell_list [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127618) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 03:54:56.366851 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3413b52d-889f-4b2a-a7ac-add5d45385b4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.232655 Sep 16 03:54:56.370991 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 435/867] 10.222.0.49 () {58 vars in 1125 bytes} [Fri Sep 16 03:54:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:54:56.381478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:56.382103 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:56.388566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:56.389058 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:56.389652 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:56.390361 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:56.390820 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:56.391273 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:56.578566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:56.593250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ae042c32-da16-4e1e-a654-fe9b9559e006 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1549 microversion: 2.1 time: 0.216284 Sep 16 03:54:56.594065 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 433/868] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:54:56 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1549 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:54:57.070281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:57.071593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:57.078349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:57.078821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:57.079281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:57.079970 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:57.080418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:57.080840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:57.221982 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:57.230816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:57.232264 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:57.233420 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-034dcf81-2822-4229-81e4-38c435b3491d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.167724 Sep 16 03:54:57.233982 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 436/869] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:57 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:58.264437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:58.265142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:58.271990 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:58.272587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:58.273023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:58.273714 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:58.274195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:58.274614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:58.443393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:58.462161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:58.463842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:58.466746 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-543483b6-f98d-4b39-bd86-120b2a6f1081 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.204716 Sep 16 03:54:58.466746 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 434/870] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:58 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:54:59.219427 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f826dd1-9958-4e4a-be28-9fe84aa0e27a"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:54:59.222544 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:59.232324 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:59.233003 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:59.233453 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:59.234165 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:59.234610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:59.235095 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:59.501207 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:54:59.508181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:54:59.540965 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:59.541669 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:59.542297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:59.543331 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:54:59.543939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:54:59.544518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:54:59.766348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:59.783950 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:59.790202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:54:59.790202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9e15f23d-6ebe-454b-b145-61592ef22c2e tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.290884 Sep 16 03:54:59.790202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 435/871] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:54:59 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:55:00.812279 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:00.812953 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:00.819341 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:00.819815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:00.820241 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:00.820913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:00.821358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:00.821770 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:00.950129 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:00.958786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:00.960492 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:00.961643 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4e06c914-70b4-447b-9791-a73f932ee9ff tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.153332 Sep 16 03:55:00.962194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 436/872] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:00 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:00.991465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-540f764a-0d2d-4add-96b1-c95190642031 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "POST /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.776171 Sep 16 03:55:00.992072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 437/873] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:54:59 2022] POST /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments => generated 194 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:01.987817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:01.988401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:01.994899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:01.995463 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:01.995896 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:01.996575 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:01.997020 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:01.997433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:02.137759 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:02.147131 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:02.148918 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:02.149843 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d9bd10b8-bd21-47f5-999b-bae52cb07a6d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1737 microversion: 2.20 time: 0.166042 Sep 16 03:55:02.150636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 437/874] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:01 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:02.837346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:02.839691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:02.846159 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:02.846669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:02.847130 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:02.847820 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:02.848264 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:02.849368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:02.881802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5e4ff718-6053-4b1f-b65c-aeed251e2e92 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049941 Sep 16 03:55:02.882352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 438/875] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:55:02 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:02.893184 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:02.893594 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:02.900527 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:02.901008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:02.901440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:02.902127 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:02.902578 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:02.903023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:02.932169 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-903de094-2780-470c-86f3-b857a6c921be tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0c145a21-9513-4a3b-b971-b695a8d1b8f6" status: 200 len: 194 microversion: 2.1 time: 0.043025 Sep 16 03:55:02.933005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 438/876] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Sep 16 03:55:02 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0c145a21-9513-4a3b-b971-b695a8d1b8f6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:03.188593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:03.189211 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:03.195953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:03.196441 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:03.196870 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:03.197564 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:03.198009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:03.198425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:03.346422 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:03.350011 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:03.352103 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:03.353424 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-352ddf17-8512-4dbe-a44d-7934753e88b9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1719 microversion: 2.20 time: 0.177172 Sep 16 03:55:03.354061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 439/877] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:03 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:04.379258 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:04.380027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:04.386593 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:04.387115 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:04.387548 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:04.388238 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:04.388684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:04.389102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:04.523943 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:04.532012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:04.533511 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:04.534680 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0e640f50-64d8-47ee-b055-95a55aa17414 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1719 microversion: 2.20 time: 0.159309 Sep 16 03:55:04.535262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 439/878] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:04 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:04.645172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cf87f8b-ef95-4d68-b349-36a143230060"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:04.648062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:04.654638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:04.655166 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:04.655612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:04.659221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:04.659221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:04.659221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:05.559905 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:05.560523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:05.567234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:05.567723 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:05.568159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:05.568849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:05.569302 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:05.569737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:05.586179 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:05.701932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:05.710268 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:05.711731 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:05.712880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-85c525da-4e29-45c5-a806-a6eafe042f9d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1719 microversion: 2.20 time: 0.157219 Sep 16 03:55:05.713423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 440/879] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:05 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:55:06.191186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:06.738229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:06.738817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:06.745664 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:06.746138 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:06.746569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:06.747273 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:06.747721 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:06.748137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:06.873139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:06.881747 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:06.883210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:06.884360 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3947c8d5-0be3-47ee-9b43-4825b82604aa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1719 microversion: 2.20 time: 0.150006 Sep 16 03:55:06.884913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 441/880] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:06 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:55:07.788132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-64a2092a-a506-46a4-9c8d-a90f18f1e28a req-b2ce79da-5f37-4aae-9a1f-63c78579489b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2263def2-54ff-4255-a751-2bdb7e32db67", "name": "network-vif-unplugged", "status": "completed", "tag": "68bc6748-c4d5-4935-8d58-9b9bd27239ad"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:07.798684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-64a2092a-a506-46a4-9c8d-a90f18f1e28a req-b2ce79da-5f37-4aae-9a1f-63c78579489b service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:07.799184 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-64a2092a-a506-46a4-9c8d-a90f18f1e28a req-b2ce79da-5f37-4aae-9a1f-63c78579489b service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:07.799618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-64a2092a-a506-46a4-9c8d-a90f18f1e28a req-b2ce79da-5f37-4aae-9a1f-63c78579489b service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:07.811345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-64a2092a-a506-46a4-9c8d-a90f18f1e28a req-b2ce79da-5f37-4aae-9a1f-63c78579489b service nova] Creating event network-vif-unplugged:68bc6748-c4d5-4935-8d58-9b9bd27239ad for instance 2263def2-54ff-4255-a751-2bdb7e32db67 on hv-cinder-85799 Sep 16 03:55:07.816346 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-64a2092a-a506-46a4-9c8d-a90f18f1e28a req-b2ce79da-5f37-4aae-9a1f-63c78579489b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032591 Sep 16 03:55:07.816938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 442/881] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:55:07.910168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:07.911214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:07.918671 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:07.919197 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:07.919635 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:07.920335 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:07.920788 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:07.921214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:08.075259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:08.085090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:08.086533 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:08.087984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9a43edf2-41ac-4d6d-81bf-53c942662261 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1719 microversion: 2.20 time: 0.181880 Sep 16 03:55:08.088579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 443/882] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:07 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:08.796275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bbb7a89f-7942-4389-ac23-79cbbf0e4a3b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "POST /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.154869 Sep 16 03:55:08.797273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 440/883] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:55:04 2022] POST /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments => generated 194 bytes in 4156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:09.113081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:09.113700 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:09.120216 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:09.120693 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:09.121125 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:09.121801 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:09.122247 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:09.122663 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:09.255856 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:09.262550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:09.264056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:09.265238 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1271b4d4-8be9-4a96-8ee2-d8b74c796365 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1722 microversion: 2.20 time: 0.156120 Sep 16 03:55:09.265784 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 444/884] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:09 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:09.293252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "163bf4c6-f6b2-469a-9fef-3046d1b30f0f"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:09.295852 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:09.305015 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:09.305513 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:09.305949 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:09.306690 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:09.312690 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:09.313174 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:09.962086 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:09.962794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:09.968990 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:09.969469 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:09.969899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:09.970579 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:09.971060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:09.971478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:10.105900 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:10.115335 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7648131c-7030-4065-b47d-2f1a4658119b tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1595 microversion: 2.1 time: 0.157495 Sep 16 03:55:10.120166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 445/885] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:09 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:10.363373 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c29cd7dc-7ad9-4912-a2b9-4d214fbd0c2d tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.075623 Sep 16 03:55:10.364138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 441/886] 10.222.0.49 () {62 vars in 1364 bytes} [Fri Sep 16 03:55:09 2022] POST /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/os-volume_attachments => generated 188 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 03:55:10.512411 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:10.513178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:10.528826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:10.529412 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:10.529969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:10.530935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:10.531577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:10.532089 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:11.157436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bebb37fb-ec0c-46e2-8b84-2086f3517a69 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/os-volume_attachments/163bf4c6-f6b2-469a-9fef-3046d1b30f0f" status: 202 len: 0 microversion: 2.20 time: 0.649479 Sep 16 03:55:11.158128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 446/887] 10.222.0.49 () {60 vars in 1457 bytes} [Fri Sep 16 03:55:10 2022] DELETE /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/os-volume_attachments/163bf4c6-f6b2-469a-9fef-3046d1b30f0f => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:55:11.226797 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:11.227518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:11.234310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:11.234964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:11.235412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:11.236759 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:11.236759 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:11.237008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:11.266921 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127618) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 03:55:11.517346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:11.652240 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-68d23a9a-563c-49dd-9231-17b1a88d7fd5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "POST /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/action" status: 202 len: 0 microversion: 2.20 time: 0.430455 Sep 16 03:55:11.652881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 442/888] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Sep 16 03:55:11 2022] POST /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:55:11.660977 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:11.661588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:11.670163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:11.670163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:11.670163 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:11.670789 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:11.671243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:11.671712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:11.815367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:11.824423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:11.826011 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:11.827410 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5e3db0cd-cf63-4522-9762-73585cfc191b tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1670 microversion: 2.20 time: 0.170353 Sep 16 03:55:11.828152 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 447/889] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:11 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:12.354816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-ae903876-5645-4b68-a402-1e4c9da5d049 req-b8df41be-af9f-48ef-a595-432916a0774d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cedd5c-2825-4c90-81bd-9300e1db80c9", "tag": "29237f39-1732-4b4a-81d4-300640dd2721"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:12.365359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ae903876-5645-4b68-a402-1e4c9da5d049 req-b8df41be-af9f-48ef-a595-432916a0774d service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:12.366121 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ae903876-5645-4b68-a402-1e4c9da5d049 req-b8df41be-af9f-48ef-a595-432916a0774d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:12.366774 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ae903876-5645-4b68-a402-1e4c9da5d049 req-b8df41be-af9f-48ef-a595-432916a0774d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:12.379317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-ae903876-5645-4b68-a402-1e4c9da5d049 req-b8df41be-af9f-48ef-a595-432916a0774d service nova] Creating event network-changed:29237f39-1732-4b4a-81d4-300640dd2721 for instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 on hv-cinder-85799 Sep 16 03:55:12.389344 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-ae903876-5645-4b68-a402-1e4c9da5d049 req-b8df41be-af9f-48ef-a595-432916a0774d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035754 Sep 16 03:55:12.389872 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 443/890] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:12.854533 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:12.855882 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:12.869499 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:12.871321 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:12.872317 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:12.873231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:12.873696 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:12.874117 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:13.148867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:13.158333 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:13.160288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:13.162164 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0e1d1166-e11c-408f-bf04-31d24e75aa20 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1670 microversion: 2.20 time: 0.312273 Sep 16 03:55:13.162955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 448/891] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:12 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1670 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:14.188911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:14.189631 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:14.199987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:14.200535 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:14.200971 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:14.201669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:14.202115 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:14.202533 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:14.378694 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:14.388487 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:14.390215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:14.392629 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c088b7b7-63fc-4e13-bd73-779f09644eaa tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.207132 Sep 16 03:55:14.392629 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 444/892] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:14 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:15.425661 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:15.425661 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:15.425661 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=78 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:15.435618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:15.436118 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:15.436557 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:15.437264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:15.437724 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:15.438138 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:15.641768 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:15.656214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:15.658677 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:15.662251 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c962cdbb-90bd-4f3e-a84d-92b81c3119ef tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.245429 Sep 16 03:55:15.663567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 449/893] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:15 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:16.061156 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1473006154"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:16.062379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:16.070146 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:16.070623 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:16.071256 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:16.072117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:16.072794 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:16.073218 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:16.260980 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.network.security_group_api [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Adding security group c830a2df-df47-4808-b092-e0cf71ac7b80 to port 29237f39-1732-4b4a-81d4-300640dd2721 Sep 16 03:55:16.694571 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:16.695879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:16.703000 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:16.716971 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:16.717539 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:16.718301 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:16.718773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:16.719228 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:16.741806 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ff81d856-0f6c-4e6a-b756-05da11119716 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "POST /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/action" status: 202 len: 0 microversion: 2.1 time: 0.685455 Sep 16 03:55:16.746863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 445/894] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:55:16 2022] POST /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:55:16.752463 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b921d1c8-c839-4bd6-a768-ad105dc9c09e req-c4c1662e-851c-4c81-b7c1-8e755e7f0702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cedd5c-2825-4c90-81bd-9300e1db80c9", "tag": "29237f39-1732-4b4a-81d4-300640dd2721"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:16.778811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b921d1c8-c839-4bd6-a768-ad105dc9c09e req-c4c1662e-851c-4c81-b7c1-8e755e7f0702 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:16.779940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b921d1c8-c839-4bd6-a768-ad105dc9c09e req-c4c1662e-851c-4c81-b7c1-8e755e7f0702 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:16.781778 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b921d1c8-c839-4bd6-a768-ad105dc9c09e req-c4c1662e-851c-4c81-b7c1-8e755e7f0702 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:16.833301 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b921d1c8-c839-4bd6-a768-ad105dc9c09e req-c4c1662e-851c-4c81-b7c1-8e755e7f0702 service nova] Creating event network-changed:29237f39-1732-4b4a-81d4-300640dd2721 for instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 on hv-cinder-85799 Sep 16 03:55:16.858169 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b921d1c8-c839-4bd6-a768-ad105dc9c09e req-c4c1662e-851c-4c81-b7c1-8e755e7f0702 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112069 Sep 16 03:55:16.863599 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 446/895] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:16.902008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:16.902728 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:16.905784 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:16.916675 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:16.918141 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:16.919362 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-078e5745-38f9-4e1f-a4ad-237a2ff25e19 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.229450 Sep 16 03:55:16.920626 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 450/896] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:16 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:16.956073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:16.958139 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:16.958951 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:16.962836 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:16.963687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:16.964298 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:17.236350 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:17.248640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4d10eacf-f1a3-4841-b1fd-58589c952e09 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1760 microversion: 2.1 time: 0.382725 Sep 16 03:55:17.258672 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 447/897] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:16 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1760 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:17.952879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:17.954995 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:17.963337 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:17.964205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:17.964930 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:17.965746 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:17.966301 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:17.966823 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:18.124828 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:18.135874 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:18.147370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:18.147370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-93b3a956-8e74-42a4-b4f8-d1410fcda5a1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.190831 Sep 16 03:55:18.147370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 451/898] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:17 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:19.166251 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:19.176888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:19.177258 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:19.177893 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:19.178886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:19.179636 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:19.180095 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:19.180521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:19.388167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:19.397782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:19.399911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:19.401610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-30cd5c37-e025-4be6-b7c6-ff5a67a65ae9 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.240614 Sep 16 03:55:19.413434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 448/899] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:19 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:19.983036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:19.983652 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:19.985914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-eae32740-56c4-4894-8e5f-22b43cf86ed0 req-3b39e5fd-d05b-47cf-b523-2f5eef3289ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d52b03d-e8ff-4942-a9d3-33b7341dad63", "tag": "2c25634f-27f9-4868-a4bb-0f555233fe5e"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:19.991204 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:20.010864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:20.011074 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:20.011192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:20.011192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:20.011192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:20.011192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:20.011552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eae32740-56c4-4894-8e5f-22b43cf86ed0 req-3b39e5fd-d05b-47cf-b523-2f5eef3289ac service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:20.011552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eae32740-56c4-4894-8e5f-22b43cf86ed0 req-3b39e5fd-d05b-47cf-b523-2f5eef3289ac service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:20.011552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-eae32740-56c4-4894-8e5f-22b43cf86ed0 req-3b39e5fd-d05b-47cf-b523-2f5eef3289ac service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:20.013065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-eae32740-56c4-4894-8e5f-22b43cf86ed0 req-3b39e5fd-d05b-47cf-b523-2f5eef3289ac service nova] Creating event network-changed:2c25634f-27f9-4868-a4bb-0f555233fe5e for instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 on hv-cinder-85799 Sep 16 03:55:20.020204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-eae32740-56c4-4894-8e5f-22b43cf86ed0 req-3b39e5fd-d05b-47cf-b523-2f5eef3289ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038113 Sep 16 03:55:20.021447 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 449/900] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:20.022923 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:55:20.431204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:20.432959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:20.443552 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:20.444721 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:20.445587 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:20.446682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:20.447633 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:20.448073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:20.478040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f44f7fa1-3b7a-413e-a3af-64a1a5bd401e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 204 len: 0 microversion: 2.1 time: 0.498985 Sep 16 03:55:20.483409 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 452/901] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:19 2022] DELETE /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:55:20.493805 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:20.493805 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:20.497404 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:20.503287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:20.504037 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:20.505056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:20.506006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:20.506624 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:20.686776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:20.699832 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:20.702289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:20.704076 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eb108a2d-c41b-4df9-a053-5235f37e93bd tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.277699 Sep 16 03:55:20.704670 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 450/902] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:20 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:55:20.726420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:20.884526 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:20.895984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c1ddef22-afb1-419c-bfcd-a09c10febc7e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.410949 Sep 16 03:55:20.896629 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 453/903] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:20 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:21.735460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:21.736172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:21.745175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:21.745711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:21.746151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:21.747057 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:21.747671 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:21.748154 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:21.919265 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:21.920523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:21.928500 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:21.928988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:21.929611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:21.930490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:21.930953 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:21.931528 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:21.951118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:21.960039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:21.961572 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:21.963140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7508f410-29c5-4b17-b9d2-c005e039a0b7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.232641 Sep 16 03:55:21.964133 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 451/904] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:21 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:22.079329 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:22.088581 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a9577a92-514a-42f6-be89-811058a245a0 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.173062 Sep 16 03:55:22.089155 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 454/905] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:21 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:22.991045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:22.991926 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:22.999002 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:22.999492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:22.999997 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:23.000804 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:23.001312 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:23.001781 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:23.115914 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:23.116511 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:23.124646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:23.125436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:23.125883 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:23.126587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:23.127540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:23.128209 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:23.205682 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:23.216450 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:23.218465 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:23.219885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2dfc214d-2fcd-471d-860f-ac7babd8a523 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.233677 Sep 16 03:55:23.224215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 452/906] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:22 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:23.332690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:23.344621 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b2529938-f406-43e4-b9af-bbbb99d324f1 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.233948 Sep 16 03:55:23.346068 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 455/907] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:23 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:24.251285 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:24.252769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:24.263154 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:24.264054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:24.264817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:24.265728 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:24.266352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:24.267291 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:24.380668 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:24.381960 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:24.394296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:24.394800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:24.399183 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:24.404507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:24.404507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:24.404507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:24.481238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:24.491528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:24.492995 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:24.494281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bf962c81-8432-49ac-a0af-35cdae4b8931 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.249247 Sep 16 03:55:24.494878 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 453/908] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:24 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:24.664085 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:24.672318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-08e1aee2-7a72-4fc0-8d6d-c3a698b76a32 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.296459 Sep 16 03:55:24.673440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 456/909] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:24 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:25.527652 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:25.528505 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:25.535432 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:25.536796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:25.537460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:25.538644 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:25.539232 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:25.539739 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:25.698401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:25.699070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:25.705401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:25.705897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:25.706333 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:25.707083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:25.707535 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:25.709315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:25.760478 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:25.769268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:25.771388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:25.772750 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3a9b2c30-8eeb-4678-9845-981e01ad91ce tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.249021 Sep 16 03:55:25.773542 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 454/910] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:25 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:25.859825 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:25.867988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f93a9879-3f76-469d-9a99-da772eb2c8d4 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1569 microversion: 2.1 time: 0.173541 Sep 16 03:55:25.868550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 457/911] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:25 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:26.798062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:26.801962 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:26.807295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:26.808126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:26.808564 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:26.809270 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:26.809720 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:26.810140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:26.896754 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:26.898075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:26.905740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:26.906388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:26.906901 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:26.911931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:26.911931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:26.911931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:26.952131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:26.962695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:26.964209 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:26.965392 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1ee1e9fb-a137-4437-a6f6-d3791877c332 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.171237 Sep 16 03:55:26.965950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 455/912] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:26 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:27.285504 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:27.293556 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-be3caea3-0426-4e0e-8feb-0bf381ba01d3 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1450 microversion: 2.1 time: 0.401629 Sep 16 03:55:27.294119 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 458/913] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:26 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1450 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:27.992227 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:27.993010 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:27.999927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.002006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.002006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.002006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.002006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.002365 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.142407 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:28.151510 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:28.152953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:28.154118 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f1060066-c77c-40c0-b9f3-67168e9d8d9f tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.166374 Sep 16 03:55:28.154674 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 456/914] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:27 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:28.319618 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:28.320858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:28.332577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.333611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.334086 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.335012 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.335471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.336273 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.337075 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:28.339388 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:28.346273 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.346849 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.347334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.348102 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.348625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.349574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.385553 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3c493b7d-6fda-4bda-bf5f-b4a73a88a0ff tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056121 Sep 16 03:55:28.386346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 457/915] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:55:28 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:28.591485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:28.591485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cb924246-466a-4539-8e85-b536fcf03bc9 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1450 microversion: 2.1 time: 0.263215 Sep 16 03:55:28.591485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 459/916] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:28 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1450 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:28.592155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:28.592155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:28.598241 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.599053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.599321 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.601060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.602390 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.602960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.647106 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bf3e87e4-43bd-49f1-8779-e26b1b69f780 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0c145a21-9513-4a3b-b971-b695a8d1b8f6" status: 200 len: 194 microversion: 2.1 time: 0.062958 Sep 16 03:55:28.647886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 458/917] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Sep 16 03:55:28 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0c145a21-9513-4a3b-b971-b695a8d1b8f6 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:28.662434 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:28.663212 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:28.672753 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.683174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.683174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.683174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:28.683174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:28.683830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:28.784187 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'services' on Instance uuid b8514653-8ce9-41b6-ba9f-d30377c5fae4 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:55:29.116702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1482da46-6e50-4aa5-be69-15d04b8c47c0 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0c145a21-9513-4a3b-b971-b695a8d1b8f6" status: 202 len: 0 microversion: 2.1 time: 0.456192 Sep 16 03:55:29.116702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 460/918] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:55:28 2022] DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0c145a21-9513-4a3b-b971-b695a8d1b8f6 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:55:29.180553 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:29.181214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:29.188233 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:29.188728 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:29.189169 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:29.189864 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:29.190596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:29.191211 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:29.219188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-7fab75a8-27c3-4909-b316-cf9558aad2f5 req-2d14966b-bc24-4b0e-8f69-77d15af29b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d52b03d-e8ff-4942-a9d3-33b7341dad63", "name": "network-vif-deleted", "tag": "2c25634f-27f9-4868-a4bb-0f555233fe5e"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:29.230040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7fab75a8-27c3-4909-b316-cf9558aad2f5 req-2d14966b-bc24-4b0e-8f69-77d15af29b54 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:29.230617 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7fab75a8-27c3-4909-b316-cf9558aad2f5 req-2d14966b-bc24-4b0e-8f69-77d15af29b54 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:29.231209 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7fab75a8-27c3-4909-b316-cf9558aad2f5 req-2d14966b-bc24-4b0e-8f69-77d15af29b54 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:29.242815 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-7fab75a8-27c3-4909-b316-cf9558aad2f5 req-2d14966b-bc24-4b0e-8f69-77d15af29b54 service nova] Creating event network-vif-deleted:2c25634f-27f9-4868-a4bb-0f555233fe5e for instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 on hv-cinder-85799 Sep 16 03:55:29.248161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-7fab75a8-27c3-4909-b316-cf9558aad2f5 req-2d14966b-bc24-4b0e-8f69-77d15af29b54 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034353 Sep 16 03:55:29.248979 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 461/919] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:55:29.347919 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:29.359654 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:29.361763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:29.362943 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a603c4c1-0f0f-4a88-bc8c-d6037b0f35a7 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.187004 Sep 16 03:55:29.363878 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 459/920] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:29 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:29.605551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:29.606544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:29.616363 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:29.616868 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:29.617613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:29.618673 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:29.619466 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:29.620196 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:29.708355 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:29.718627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1a4e9f7d-c3d2-4975-a362-856bed599f0f tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1219 microversion: 2.1 time: 0.118057 Sep 16 03:55:29.719232 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 462/921] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:29 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:30.388691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:30.389425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:30.396437 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:30.396827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:30.397263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:30.397944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:30.398393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:30.398818 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:30.559149 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:30.568396 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:30.570143 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:30.571808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d097d04c-b0ea-4705-804f-cbdf20e997e5 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.187132 Sep 16 03:55:30.572935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 460/922] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:30 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:55:30.667706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-28ce17dd-1e87-4c27-b761-724d0fd53720 req-ab80a806-9d1b-455c-b892-667f35b4608d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2263def2-54ff-4255-a751-2bdb7e32db67", "name": "network-vif-plugged", "status": "completed", "tag": "68bc6748-c4d5-4935-8d58-9b9bd27239ad"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:30.679898 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-28ce17dd-1e87-4c27-b761-724d0fd53720 req-ab80a806-9d1b-455c-b892-667f35b4608d service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:30.680459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-28ce17dd-1e87-4c27-b761-724d0fd53720 req-ab80a806-9d1b-455c-b892-667f35b4608d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:30.680956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-28ce17dd-1e87-4c27-b761-724d0fd53720 req-ab80a806-9d1b-455c-b892-667f35b4608d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:30.695896 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-28ce17dd-1e87-4c27-b761-724d0fd53720 req-ab80a806-9d1b-455c-b892-667f35b4608d service nova] Creating event network-vif-plugged:68bc6748-c4d5-4935-8d58-9b9bd27239ad for instance 2263def2-54ff-4255-a751-2bdb7e32db67 on hv-cinder-85799 Sep 16 03:55:30.701011 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-28ce17dd-1e87-4c27-b761-724d0fd53720 req-ab80a806-9d1b-455c-b892-667f35b4608d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038052 Sep 16 03:55:30.702071 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 463/923] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:30.760128 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:30.760780 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:30.783497 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:30.787310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:30.787900 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:30.796385 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:30.798342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:30.814819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:30.843761 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:30.843761 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:30.843761 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:30.843761 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lazy-loading 'fault' on Instance uuid 1d52b03d-e8ff-4942-a9d3-33b7341dad63 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:55:30.844257 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:30.894079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede7a69d69084b3583433547473532be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a1aef0396c463d8a10f0ee811e1f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:30.900650 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ebdb706-c2b6-4bed-9714-da2d8935bde5 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 200 len: 1224 microversion: 2.1 time: 0.162735 Sep 16 03:55:30.901575 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 461/924] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:30 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 1224 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:31.322384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:31.322991 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:31.329694 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.329694 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.330183 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.330881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.331378 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.331803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.361187 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d9ecf4a4-dcd2-4aac-b0c8-0dd367139d31 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0cf87f8b-ef95-4d68-b349-36a143230060" status: 200 len: 194 microversion: 2.1 time: 0.043710 Sep 16 03:55:31.361792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 464/925] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Sep 16 03:55:31 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0cf87f8b-ef95-4d68-b349-36a143230060 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:55:31.379554 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:31.380045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:31.386856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.387355 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.387786 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.388470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.389018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.389571 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.475129 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'services' on Instance uuid b8514653-8ce9-41b6-ba9f-d30377c5fae4 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:55:31.609367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:31.610074 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:31.616781 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.617263 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.617692 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.618521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.618996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.619395 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.734473 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dc380816-6928-4899-9ac7-ca6a772dc0e3 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0cf87f8b-ef95-4d68-b349-36a143230060" status: 202 len: 0 microversion: 2.1 time: 0.359063 Sep 16 03:55:31.735277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 462/926] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:55:31 2022] DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments/0cf87f8b-ef95-4d68-b349-36a143230060 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:55:31.755886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:31.756188 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:31.760275 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:31.766146 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.766570 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.767043 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.767799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.769978 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.771201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.774564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:31.776197 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:31.777388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e9e6879a-5029-4f43-8d49-ed5ce13c3b1c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.172523 Sep 16 03:55:31.778301 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 465/927] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:31 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:55:31.797597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-30a684bb-0a3f-4876-9d92-6a010ca585dd tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/ips" status: 200 len: 150 microversion: 2.1 time: 0.057063 Sep 16 03:55:31.798175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 463/928] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:55:31 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:31.931195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:31.931802 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] [instance: 1d52b03d-e8ff-4942-a9d3-33b7341dad63] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:31.938119 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.938604 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.939053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.939740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:31.940186 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:31.940602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:31.954030 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] HTTP exception thrown: Instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 could not be found. Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Request method failure captured: Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 HTTP/1.1 Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_JJW371rww4wi_-oXoAJ5Cu0Rv80rSSS5lUdTKEA8m8WiBzKiK10-gE3aCUAkybp7CwgsB_N21vyRfx91INTuzcei1pYOhT53-k36nEEPOXPwJj-7pPWH3NN8pVxvbnnZcs_NIS_-9wUg0iE-3VkxzoOaIVVs1Lz8LpwHEKraOnvJE Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 37a1aef0396c463d8a10f0ee811e1f2a Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestShelveInstance-1606581625 Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:31.955722 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/37a1aef0396c463d8a10f0ee811e1f2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_37a1aef0396c463d8a10f0ee811e1f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/37a1aef0396c463d8a10f0ee811e1f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/37a1aef0396c463d8a10f0ee811e1f2a"}]}] Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestShelveInstance-1606581625 Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 37a1aef0396c463d8a10f0ee811e1f2a Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestShelveInstance-1606581625 Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-TestShelveInstance-1606581625-project Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: ede7a69d69084b3583433547473532be Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestShelveInstance-1606581625-project Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 could not be found. Sep 16 03:55:31.964050 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '1d52b03d-e8ff-4942-a9d3-33b7341dad63'} Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 could not be found. Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:31.965636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 could not be found. Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 could not be found. Sep 16 03:55:31.967518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:31.968941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Returning 404 to user: Instance 1d52b03d-e8ff-4942-a9d3-33b7341dad63 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:31.968941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dcf199bf-2e0f-4a13-b3e2-5208da5f4a97 tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63" status: 404 len: 111 microversion: 2.1 time: 0.030247 Sep 16 03:55:31.968941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 466/929] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:31 2022] GET /compute/v2.1/servers/1d52b03d-e8ff-4942-a9d3-33b7341dad63 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:32.215503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b6c1b489-5838-4679-9b78-5cda3999a27e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] Calling method '.version_select at 0x7fba7c5a0040>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:32.313869 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b6c1b489-5838-4679-9b78-5cda3999a27e tempest-TestShelveInstance-1606581625 tempest-TestShelveInstance-1606581625-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-752799329" status: 202 len: 0 microversion: 2.1 time: 0.102223 Sep 16 03:55:32.315888 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 464/930] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-752799329 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:55:32.803729 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:32.806435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:32.814762 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:32.815316 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:32.815975 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:32.818039 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:32.818691 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:32.819314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:33.098690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:33.108534 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:33.110299 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:33.111737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-290d2bc9-d47b-4f9d-a4fb-d9ce5866827a tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.311903 Sep 16 03:55:33.112802 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 467/931] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:32 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:55:33.623261 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "208fcaf6-5600-4c86-863f-ebe0ee7d1f85"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:33.626366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:33.633932 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:33.634546 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:33.635275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:33.636191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:33.636763 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:33.637261 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.037440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:34.045292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:34.056756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:34.056756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:34.056756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.056756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:34.058243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:34.058243 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.100061 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b02aa7d0-bd12-4cd6-a690-119d0902a651 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067051 Sep 16 03:55:34.107286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 468/932] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:55:34 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 03:55:34.139052 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:34.139626 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:34.146285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:34.147003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:34.147660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.148661 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:34.149272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:34.150070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.382674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:34.392858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:34.394752 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:34.397940 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6527a526-19dc-4861-a2b6-d05c6b0eaa82 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1728 microversion: 2.20 time: 0.263096 Sep 16 03:55:34.399202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 469/933] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:34 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1728 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:55:34.404440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:34.406562 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:34.413791 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:34.414303 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:34.414726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.415471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:34.415909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:34.416508 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.465595 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d48eed6a-ee90-4ee4-92f7-175bbb219541 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065126 Sep 16 03:55:34.492949 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 470/934] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:55:34 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 03:55:34.577442 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:34.577897 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:34.584581 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:34.584581 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:34.585787 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.585787 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:34.586221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:34.586641 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:34.614717 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:34.623730 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:55:34.728684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-104b3504-c1f9-492b-889d-30b5948a1988 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "POST /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111901 Sep 16 03:55:34.735729 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 465/935] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 16 03:55:33 2022] POST /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments => generated 194 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:35.129889 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9ccb8d69-e877-4eda-9146-f12e59ef27a9 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 204 len: 0 microversion: 2.1 time: 0.555990 Sep 16 03:55:35.131351 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 471/936] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:34 2022] DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:55:35.143980 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:35.146035 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:35.156101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:35.157410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:35.158077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:35.159022 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:35.159683 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:35.160316 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:35.413188 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:35.421208 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a21f2b9c-bf62-4bad-9b24-8a3f1721a474 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1675 microversion: 2.1 time: 0.285266 Sep 16 03:55:35.422021 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 466/937] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:35 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:35.425680 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:35.426463 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:35.433867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:35.434350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:35.434785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:35.435692 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:35.436144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:35.436564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:35.583321 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:35.596516 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:35.598100 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:35.600157 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-37f1c4fb-57f7-4dcc-9eb9-dec2e4c43f79 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1715 microversion: 2.20 time: 0.178771 Sep 16 03:55:35.601304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 472/938] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:55:35 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1715 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 03:55:36.450653 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:36.450653 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:36.458528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:36.459490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:36.460353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:36.461221 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:36.461675 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:36.462098 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:36.633230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:36.643182 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-04ee3715-a2f7-4eba-99ce-70b53c1a6df6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1675 microversion: 2.1 time: 0.200988 Sep 16 03:55:36.643967 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 467/939] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:36 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:37.669916 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:37.669916 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:37.675824 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:37.677287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:37.677716 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:37.678597 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:37.679112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:37.679811 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:37.921552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:37.931192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a6876e11-e0de-4e62-90ce-a18f7136e10b tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1675 microversion: 2.1 time: 0.266307 Sep 16 03:55:37.935168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 473/940] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:37 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1675 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:38.381769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-e6737ba9-7f22-4e3a-834d-0fec73ca4437 req-d8f7507b-fe21-4202-9781-587bb068fdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8514653-8ce9-41b6-ba9f-d30377c5fae4", "name": "network-vif-deleted", "tag": "0d6f5f36-2095-4132-9bda-3dd4c203721f"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:38.392785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e6737ba9-7f22-4e3a-834d-0fec73ca4437 req-d8f7507b-fe21-4202-9781-587bb068fdb7 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:38.393494 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e6737ba9-7f22-4e3a-834d-0fec73ca4437 req-d8f7507b-fe21-4202-9781-587bb068fdb7 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:38.393919 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e6737ba9-7f22-4e3a-834d-0fec73ca4437 req-d8f7507b-fe21-4202-9781-587bb068fdb7 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:38.406112 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-e6737ba9-7f22-4e3a-834d-0fec73ca4437 req-d8f7507b-fe21-4202-9781-587bb068fdb7 service nova] Creating event network-vif-deleted:0d6f5f36-2095-4132-9bda-3dd4c203721f for instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 on hv-cinder-85799 Sep 16 03:55:38.411433 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-e6737ba9-7f22-4e3a-834d-0fec73ca4437 req-d8f7507b-fe21-4202-9781-587bb068fdb7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034067 Sep 16 03:55:38.412701 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 468/941] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:38.956447 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:38.958069 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:38.969331 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:38.970139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:38.971079 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:38.974540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:38.975941 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:38.976962 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:39.059287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:39.059793 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:39.060238 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:39.060700 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lazy-loading 'fault' on Instance uuid b8514653-8ce9-41b6-ba9f-d30377c5fae4 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:55:39.115373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f410d691e364880b13bb9144bbc5e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94b50976295422c9c8374155cf2d2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:39.123574 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-09a5988a-2485-4fa3-8598-f4a84e19edd6 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 200 len: 1328 microversion: 2.1 time: 0.172786 Sep 16 03:55:39.125789 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 474/942] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:38 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 1328 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:39.785612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:39.790462 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:39.798937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:39.799639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:39.800783 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:39.803006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:39.803955 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:39.804545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:40.144543 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e8433925-6114-4eb1-9f26-0885cb9e6c23 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "POST /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/action" status: 202 len: 0 microversion: 2.1 time: 0.365643 Sep 16 03:55:40.145305 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 469/943] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:55:39 2022] POST /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:55:40.148750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:40.149447 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:40.153928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:40.154853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:40.156121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:40.156790 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:40.157461 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:40.158310 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:40.159130 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:40.159712 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:40.162405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:40.163434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:40.164455 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:40.165468 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:40.165902 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:40.166356 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] HTTP exception thrown: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Request method failure captured: Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 HTTP/1.1 Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IG9EW9gXsk9EoqLDEo1IaOSppDMpstPxJK2BGcL99eOsWhuO2Zk7AbMr4ExedU30Dj_V5wLU3LCroeyB-5kV2Vt-9i1qBR9XZCVa6-Rc1fVINIx4IM9Rr0mAXeI4PAcb8iIhrIrqCiXZoyRUwNeiF0gECfRZzdj4k0gLyB1y7XeQ8 Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:40.177845 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}] Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 8f410d691e364880b13bb9144bbc5e7d Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:40.180146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'b8514653-8ce9-41b6-ba9f-d30377c5fae4'} Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:40.180924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:40.182160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:40.183987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Returning 404 to user: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:40.183987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-323d5662-2ee8-4780-9332-56a5c8a955ce tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 404 len: 111 microversion: 2.1 time: 0.034313 Sep 16 03:55:40.183987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 475/944] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:40 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:40.188351 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9eb2d8aa-7889-4ead-914c-114b019f306d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '.version_select at 0x7fba7c53aa60>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:40.325367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9eb2d8aa-7889-4ead-914c-114b019f306d tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110307911" status: 202 len: 0 microversion: 2.1 time: 0.140634 Sep 16 03:55:40.326680 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 476/945] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Sep 16 03:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110307911 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:55:40.616085 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:40.626122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5d518e22-4158-4b49-9ed3-f8b74fbab2c0 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1752 microversion: 2.1 time: 0.475762 Sep 16 03:55:40.626122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 470/946] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:40 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1752 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:41.650862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:41.651570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:41.658629 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:41.659153 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:41.659594 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:41.660297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:41.661425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:41.663643 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:41.858196 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:41.867529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4f377cb8-3826-4406-b482-735d2cc03b29 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.221133 Sep 16 03:55:41.868584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 477/947] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:41 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:42.892983 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:42.893698 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:42.900396 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:42.901001 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:42.901557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:42.902340 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:42.902864 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:42.903421 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:43.064408 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:43.073449 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a5ebe1d5-4ff8-456a-9ca5-c65e09bff290 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.184774 Sep 16 03:55:43.075046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 471/948] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:42 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:43.613205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:43.614432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:43.621274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:43.621756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:43.622194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:43.622888 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:43.623369 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:43.623791 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:43.729853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lazy-loading 'services' on Instance uuid 0584f7f8-cc04-4019-9971-a0e59ee918f0 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:55:44.052908 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-caec8f9a-6cc8-4e71-b9fa-014e01abcc8c tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments/208fcaf6-5600-4c86-863f-ebe0ee7d1f85" status: 202 len: 0 microversion: 2.1 time: 0.443511 Sep 16 03:55:44.054431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 478/949] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:55:43 2022] DELETE /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments/208fcaf6-5600-4c86-863f-ebe0ee7d1f85 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:55:44.063182 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:44.065483 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:44.088699 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:44.089196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:44.089817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:44.090749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:44.091614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:44.092284 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:44.100551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:44.101438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:44.111873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:44.111873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:44.111873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:44.111873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:44.112285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:44.112285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:44.129756 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-49031405-5a6a-406a-af3c-2b750b6d31a4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071468 Sep 16 03:55:44.130322 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 472/950] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:55:44 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:44.264570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:44.277667 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7102cc1d-ff97-48ef-bddf-dd6bd9b6c39e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.183711 Sep 16 03:55:44.278264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 479/951] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:44 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:44.499043 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:44.499877 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:44.509412 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:44.510032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:44.510512 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:44.511303 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:44.511790 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:44.512311 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:44.528411 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] HTTP exception thrown: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Request method failure captured: Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 HTTP/1.1 Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IG9EW9gXsk9EoqLDEo1IaOSppDMpstPxJK2BGcL99eOsWhuO2Zk7AbMr4ExedU30Dj_V5wLU3LCroeyB-5kV2Vt-9i1qBR9XZCVa6-Rc1fVINIx4IM9Rr0mAXeI4PAcb8iIhrIrqCiXZoyRUwNeiF0gECfRZzdj4k0gLyB1y7XeQ8 Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:55:44.530138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}] Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: 8f410d691e364880b13bb9144bbc5e7d Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.531808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'b8514653-8ce9-41b6-ba9f-d30377c5fae4'} Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:44.532817 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.534598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.537191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Returning 404 to user: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:44.537191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eaf6e9aa-05f9-4ce1-a91a-993d649138b7 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 404 len: 111 microversion: 2.1 time: 0.036721 Sep 16 03:55:44.537191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 473/952] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:44 2022] DELETE /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:44.543323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:44.545552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: b8514653-8ce9-41b6-ba9f-d30377c5fae4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:44.561285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:44.562067 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:44.562564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:44.563322 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:44.563780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:44.564205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:44.580474 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] HTTP exception thrown: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Request method failure captured: Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 HTTP/1.1 Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IG9EW9gXsk9EoqLDEo1IaOSppDMpstPxJK2BGcL99eOsWhuO2Zk7AbMr4ExedU30Dj_V5wLU3LCroeyB-5kV2Vt-9i1qBR9XZCVa6-Rc1fVINIx4IM9Rr0mAXeI4PAcb8iIhrIrqCiXZoyRUwNeiF0gECfRZzdj4k0gLyB1y7XeQ8 Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:44.582168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}] Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 8f410d691e364880b13bb9144bbc5e7d Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.584564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'b8514653-8ce9-41b6-ba9f-d30377c5fae4'} Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:44.587267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. Sep 16 03:55:44.588873 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:44.590244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Returning 404 to user: Instance b8514653-8ce9-41b6-ba9f-d30377c5fae4 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:44.590244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cc8a1001-ed81-4a0c-90cc-18e40266e56a tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4" status: 404 len: 111 microversion: 2.1 time: 0.045228 Sep 16 03:55:44.590244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 480/953] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:44 2022] GET /compute/v2.1/servers/b8514653-8ce9-41b6-ba9f-d30377c5fae4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:45.142203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:45.144404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:45.151354 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:45.151830 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:45.152258 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:45.152940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:45.153383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:45.153798 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:45.182405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cb127a64-c683-4047-9db7-4c959bd3668a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044196 Sep 16 03:55:45.183214 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 474/954] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:55:45 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:45.303106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:45.303637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:45.310410 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:45.310893 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:45.321674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:45.321674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:45.321674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:45.321674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:45.454049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:45.462469 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e0b07b81-c63e-42bd-a20a-4014e3e7547a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.164529 Sep 16 03:55:45.463056 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 481/955] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:45 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:46.069464 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:46.070297 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:46.079491 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.079987 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.080431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.081132 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.081620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.082294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.096663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] HTTP exception thrown: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Request method failure captured: Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 HTTP/1.1 Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IG9EW9gXsk9EoqLDEo1IaOSppDMpstPxJK2BGcL99eOsWhuO2Zk7AbMr4ExedU30Dj_V5wLU3LCroeyB-5kV2Vt-9i1qBR9XZCVa6-Rc1fVINIx4IM9Rr0mAXeI4PAcb8iIhrIrqCiXZoyRUwNeiF0gECfRZzdj4k0gLyB1y7XeQ8 Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:55:46.098896 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}] Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: 8f410d691e364880b13bb9144bbc5e7d Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.107009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '2df7ed3f-dd6d-4312-a548-591443add019'} Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:46.108336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.109972 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.111660 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Returning 404 to user: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:46.111660 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-de1c437a-82bd-4793-be12-f81246face95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 404 len: 111 microversion: 2.1 time: 0.035294 Sep 16 03:55:46.111660 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 475/956] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:46 2022] DELETE /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:46.114297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:46.115118 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] [instance: 2df7ed3f-dd6d-4312-a548-591443add019] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:46.118072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:46.121530 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.122023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.122430 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.128407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.128407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.128407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.140159 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] HTTP exception thrown: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Request method failure captured: Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 HTTP/1.1 Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IG9EW9gXsk9EoqLDEo1IaOSppDMpstPxJK2BGcL99eOsWhuO2Zk7AbMr4ExedU30Dj_V5wLU3LCroeyB-5kV2Vt-9i1qBR9XZCVa6-Rc1fVINIx4IM9Rr0mAXeI4PAcb8iIhrIrqCiXZoyRUwNeiF0gECfRZzdj4k0gLyB1y7XeQ8 Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:46.141867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e94b50976295422c9c8374155cf2d2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e94b50976295422c9c8374155cf2d2c2"}]}] Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: e94b50976295422c9c8374155cf2d2c2 Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1062280343 Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 8f410d691e364880b13bb9144bbc5e7d Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1062280343-project Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.143282 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '2df7ed3f-dd6d-4312-a548-591443add019'} Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:46.144114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. Sep 16 03:55:46.146090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:46.147600 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] Returning 404 to user: Instance 2df7ed3f-dd6d-4312-a548-591443add019 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:46.147600 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2c17c1bd-734c-4fac-a42d-43b115534d95 tempest-AttachVolumeTestJSON-1062280343 tempest-AttachVolumeTestJSON-1062280343-project] 10.222.0.49 "GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019" status: 404 len: 111 microversion: 2.1 time: 0.034758 Sep 16 03:55:46.148365 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 482/957] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:46 2022] GET /compute/v2.1/servers/2df7ed3f-dd6d-4312-a548-591443add019 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:46.196099 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:46.198293 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:46.204732 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.205219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.205664 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.206432 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.206812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.207263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.238560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-835bd6f0-2992-4695-b0fe-36e9add29ffa tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046658 Sep 16 03:55:46.239254 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 476/958] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:55:46 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 03:55:46.304606 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:46.305160 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:46.313344 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.313838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.314272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.321720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.321720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.321720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.349189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:55:46.485307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:46.485922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:46.492001 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.492499 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.492938 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.493634 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.494085 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.494506 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.655017 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:46.663445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-abf0bac4-cbfd-4a08-9ea7-2edd57faec42 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.182018 Sep 16 03:55:46.664104 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 477/959] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:46 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:55:46.758238 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6a02c583-9a69-461f-8cff-7928eb297538 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 204 len: 0 microversion: 2.1 time: 0.458163 Sep 16 03:55:46.758835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 483/960] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:46 2022] DELETE /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:55:46.770935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:46.771554 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:46.777528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.778007 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.778438 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.779160 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:46.779617 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:46.780046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:46.796348 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:46.914381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:46.922152 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5f55e69a-0372-429e-aa56-1bbec910c88a tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1680 microversion: 2.1 time: 0.155311 Sep 16 03:55:46.924623 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 478/961] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:46 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:47.693457 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:47.694272 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:47.700772 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:47.701327 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:47.701830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:47.702609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:47.703241 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:47.703639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:47.947819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:47.948446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:47.956117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:47.956607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:47.957045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:47.958096 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:47.958620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:47.959086 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:48.113495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:48.123941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a740091f-669c-404c-bbc2-da793e591d12 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1680 microversion: 2.1 time: 0.180732 Sep 16 03:55:48.134789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 479/962] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:47 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:48.233431 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:48.243473 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9eb6eb36-312b-45e6-b787-2ad4239cc73e tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.554953 Sep 16 03:55:48.244245 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 484/963] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:47 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:49.150774 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:49.150774 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:49.158426 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:49.160046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:49.160684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:49.161620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:49.162245 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:49.162849 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:49.267713 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:49.268373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:49.280871 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:49.284424 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:49.284953 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:49.285755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:49.286288 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:49.287448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:49.349131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:49.360954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7b001b1f-a831-4cc8-bbd1-e8e4a5f90f91 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1680 microversion: 2.1 time: 0.216367 Sep 16 03:55:49.362062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 480/964] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:49 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:49.673151 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:49.682732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0adf7655-0928-432d-8f4a-513dbca7a6cb tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.419348 Sep 16 03:55:49.699069 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 485/965] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:49 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:49.972542 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-65f2c8c4-8021-446a-8726-078b2b2b9a86 req-8e97e411-bd34-43b0-8438-a8a69026e321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0584f7f8-cc04-4019-9971-a0e59ee918f0", "name": "network-vif-deleted", "tag": "59cf9322-5f98-4a80-b3ba-193361cc8857"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:55:49.995741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-65f2c8c4-8021-446a-8726-078b2b2b9a86 req-8e97e411-bd34-43b0-8438-a8a69026e321 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:50.002172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-65f2c8c4-8021-446a-8726-078b2b2b9a86 req-8e97e411-bd34-43b0-8438-a8a69026e321 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:50.002172 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-65f2c8c4-8021-446a-8726-078b2b2b9a86 req-8e97e411-bd34-43b0-8438-a8a69026e321 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:50.023460 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-65f2c8c4-8021-446a-8726-078b2b2b9a86 req-8e97e411-bd34-43b0-8438-a8a69026e321 service nova] Creating event network-vif-deleted:59cf9322-5f98-4a80-b3ba-193361cc8857 for instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 on hv-cinder-85799 Sep 16 03:55:50.034200 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-65f2c8c4-8021-446a-8726-078b2b2b9a86 req-8e97e411-bd34-43b0-8438-a8a69026e321 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065456 Sep 16 03:55:50.035006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 481/966] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:50.389340 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:50.390568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:50.399298 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:50.401055 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:50.401793 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:50.402753 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:50.403924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:50.404472 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:50.498588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:50.498588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:50.498588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:50.498588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lazy-loading 'fault' on Instance uuid 0584f7f8-cc04-4019-9971-a0e59ee918f0 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:55:50.502465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:50.572732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7df9be8475405eba924b59a7bd6bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee4a40c6c264553a14e0eff367da4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:50.583116 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-15643fb3-ecec-4d29-9f42-dfde4194cdd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 200 len: 1330 microversion: 2.1 time: 0.199896 Sep 16 03:55:50.583456 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 486/967] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:50 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 1330 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:50.727123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:50.728488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:50.735911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:50.737939 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:50.739262 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:50.740260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:50.741263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:50.742128 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:50.743502 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:50.981902 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:50.992953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-61e50ce7-e78e-4061-9565-96b564877822 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.283043 Sep 16 03:55:50.993533 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 482/968] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:50 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:51.605520 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:51.606165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:51.613379 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:51.613962 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:51.614325 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:51.615144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:51.615554 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:51.615969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:51.629772 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 HTTP/1.1 Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:51.631611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:51.633023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '0584f7f8-cc04-4019-9971-a0e59ee918f0'} Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:51.633909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:51.635573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:51.637240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:51.637240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-152a22aa-00ab-4238-b57f-84d45478acd4 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 404 len: 111 microversion: 2.1 time: 0.031369 Sep 16 03:55:51.637240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 487/969] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:51 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:51.641944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d0a53f7a-959e-404e-a6fd-092896db2782 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '.version_select at 0x7fba7c676b80>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:51.776203 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d0a53f7a-959e-404e-a6fd-092896db2782 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-162716386" status: 202 len: 0 microversion: 2.1 time: 0.138086 Sep 16 03:55:51.776858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 483/970] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 16 03:55:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-162716386 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:55:52.018210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:52.018835 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:52.026790 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:52.027374 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:52.027829 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:52.028588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:52.029827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:52.030656 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:52.312150 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:52.321084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f96c2674-4c8c-4900-9d48-8c16b851a622 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1757 microversion: 2.1 time: 0.307185 Sep 16 03:55:52.323054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 488/971] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:52 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1757 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:53.346826 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:53.347474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:53.355558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:53.356202 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:53.356638 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:53.357340 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:53.357787 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:53.358400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:53.527975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:55:53.536452 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4b6d23bc-d18a-4927-8d49-208ad08d719f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1760 microversion: 2.1 time: 0.194921 Sep 16 03:55:53.538574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 484/972] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:53 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1760 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:54.042541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:54.043078 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:54.050140 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:54.050625 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:54.051104 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:54.051797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:54.052259 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:54.053409 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:54.069147 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 HTTP/1.1 Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:54.070756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.073081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '0584f7f8-cc04-4019-9971-a0e59ee918f0'} Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:54.074538 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.077022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.078996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:54.078996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2fd08b42-f67b-44be-8cb8-6ff6d1a77438 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 404 len: 111 microversion: 2.1 time: 0.033556 Sep 16 03:55:54.078996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 489/973] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:54 2022] DELETE /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:54.081526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:54.082140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 0584f7f8-cc04-4019-9971-a0e59ee918f0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:54.089920 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:54.090405 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:54.090835 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:54.091815 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:54.092260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:54.092678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:54.106599 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 HTTP/1.1 Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:55:54.108276 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.109776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '0584f7f8-cc04-4019-9971-a0e59ee918f0'} Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:54.110541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. Sep 16 03:55:54.111871 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:54.113012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 0584f7f8-cc04-4019-9971-a0e59ee918f0 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:54.113012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5d1cdd8e-12f2-4d95-885a-fc1a61993296 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0" status: 404 len: 111 microversion: 2.1 time: 0.032771 Sep 16 03:55:54.113012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 485/974] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:54 2022] GET /compute/v2.1/servers/0584f7f8-cc04-4019-9971-a0e59ee918f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:55.417913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:55.418448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:55.434179 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:55.434726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:55.435254 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:55.435953 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:55.436405 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:55.436826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:55.451550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce HTTP/1.1 Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:55.452998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.454399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'bb6e8c47-3155-423c-ac27-8e71fc56bbce'} Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:55.455205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.456524 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.457828 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:55.457828 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b5fad3a0-84af-4a2e-9984-87636d6e0f16 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 404 len: 111 microversion: 2.1 time: 0.040927 Sep 16 03:55:55.457828 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 490/975] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:55 2022] DELETE /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 03:55:55.463628 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:55.464242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: bb6e8c47-3155-423c-ac27-8e71fc56bbce] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:55.470922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:55.471418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:55.471867 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:55.472538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:55.472986 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:55.473401 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:55.488990 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce HTTP/1.1 Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:55:55.490525 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.493252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'bb6e8c47-3155-423c-ac27-8e71fc56bbce'} Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:55.494055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. Sep 16 03:55:55.495886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.497291 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance bb6e8c47-3155-423c-ac27-8e71fc56bbce could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:55.497291 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b1c7baf7-8598-4190-b9be-590dc67db6ec tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce" status: 404 len: 111 microversion: 2.1 time: 0.032409 Sep 16 03:55:55.497291 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 486/976] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:55 2022] GET /compute/v2.1/servers/bb6e8c47-3155-423c-ac27-8e71fc56bbce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:55.502293 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:55.502785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:55.509115 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:55.509592 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:55.510027 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:55.510755 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:55.511223 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:55.511636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:55.525625 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 HTTP/1.1 Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:55.527188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.528657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '4cb8293f-e305-41ce-82f8-3a111fb43322'} Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:55.529448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.531048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.533082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:55.533082 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-df977e7a-1d6d-470a-b760-f78b99937d61 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 404 len: 111 microversion: 2.1 time: 0.030330 Sep 16 03:55:55.533509 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 491/977] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:55 2022] DELETE /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:55.538335 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:55.538335 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 4cb8293f-e305-41ce-82f8-3a111fb43322] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:55.545123 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:55.545605 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:55.546039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:55.546725 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:55.547299 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:55.547728 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:55.564244 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 HTTP/1.1 Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:55:55.565770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.567242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '4cb8293f-e305-41ce-82f8-3a111fb43322'} Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:55.568101 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. Sep 16 03:55:55.569366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:55.570589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 4cb8293f-e305-41ce-82f8-3a111fb43322 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:55.570589 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3afa568b-6541-4733-8770-c10e7d024502 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322" status: 404 len: 111 microversion: 2.1 time: 0.033561 Sep 16 03:55:55.571140 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 487/978] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:55 2022] GET /compute/v2.1/servers/4cb8293f-e305-41ce-82f8-3a111fb43322 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:55.637810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8198f42a-f228-40f0-8f8a-e10a444c7b9e tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c53ab80>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:55.686662 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8198f42a-f228-40f0-8f8a-e10a444c7b9e tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/645d9572-8315-4abb-b666-69b1776f99cc" status: 200 len: 351 microversion: 2.1 time: 0.052522 Sep 16 03:55:55.687257 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 492/979] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:55:55 2022] GET /compute/v2.1/os-volumes/645d9572-8315-4abb-b666-69b1776f99cc => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:56.876702 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:56.877265 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:56.884232 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:56.884919 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:56.885357 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:56.886050 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:56.886557 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:56.886990 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d HTTP/1.1 Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:55:56.906663 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.908731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '6fee7fbd-189b-4a53-ba78-d66512c7b09d'} Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:56.909676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.911059 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.912423 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:56.912423 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-225f296a-f262-452f-a0e7-e7feab588585 tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 404 len: 111 microversion: 2.1 time: 0.031944 Sep 16 03:55:56.912423 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 488/980] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:55:56 2022] DELETE /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:56.914183 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:56.915425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] [instance: 6fee7fbd-189b-4a53-ba78-d66512c7b09d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:55:56.921714 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:56.922206 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:56.922646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:56.923476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:55:56.923789 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:55:56.924212 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:55:56.937994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] HTTP exception thrown: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Request method failure captured: Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d HTTP/1.1 Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_IMkGzA4XH9O8cEOqPKpJBQlpo1vuWnxGmvaG5qoD5qWcTGlBSSNLHAgCQFf6vNWOxMJPHy6lR5Iuh11EjaHW5USh30NbEGckgcCc8OXd6o4OSE1_OnhRcfoaE3NdrQS0JNbiFIF_qmKv5LDnv6wCxh39geYt9zAbzahs2s_Pqywco Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:55:56.939553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8ee4a40c6c264553a14e0eff367da4a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8ee4a40c6c264553a14e0eff367da4a0"}]}] Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 8ee4a40c6c264553a14e0eff367da4a0 Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1762556014 Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: ff7df9be8475405eba924b59a7bd6bb0 Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1762556014-project Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.941903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '6fee7fbd-189b-4a53-ba78-d66512c7b09d'} Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:55:56.943266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. Sep 16 03:55:56.945423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:55:56.947580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] Returning 404 to user: Instance 6fee7fbd-189b-4a53-ba78-d66512c7b09d could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:55:56.947580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5a2a5a35-2dbd-4290-b913-d266a9c7790f tempest-AttachVolumeNegativeTest-1762556014 tempest-AttachVolumeNegativeTest-1762556014-project] 10.222.0.49 "GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d" status: 404 len: 111 microversion: 2.1 time: 0.031696 Sep 16 03:55:56.947580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 493/981] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:55:56 2022] GET /compute/v2.1/servers/6fee7fbd-189b-4a53-ba78-d66512c7b09d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:57.448982 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1761e3a6-c131-40de-82b2-2e9745467147 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c5aa0d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:57.501292 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1761e3a6-c131-40de-82b2-2e9745467147 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1bf62b16-60cf-4372-9dce-f2deb02d695a" status: 200 len: 351 microversion: 2.1 time: 0.057020 Sep 16 03:55:57.501953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 489/982] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:55:57 2022] GET /compute/v2.1/os-volumes/1bf62b16-60cf-4372-9dce-f2deb02d695a => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:59.267685 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-37a9376c-fe64-4ad3-96ff-487ed9e934eb tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c5c0d30>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:59.340748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-37a9376c-fe64-4ad3-96ff-487ed9e934eb tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4e7c659e-2070-4a99-8faf-1c43bccb457c" status: 200 len: 350 microversion: 2.1 time: 0.076980 Sep 16 03:55:59.341340 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 494/983] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:55:59 2022] GET /compute/v2.1/os-volumes/4e7c659e-2070-4a99-8faf-1c43bccb457c => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:59.355761 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1afc1d38-98a3-4cab-9b34-1087c1c34b41 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c5a09d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:59.455415 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1afc1d38-98a3-4cab-9b34-1087c1c34b41 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.104017 Sep 16 03:55:59.455996 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 490/984] 10.222.0.49 () {58 vars in 1134 bytes} [Fri Sep 16 03:55:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:59.472765 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f9765833-c18b-4c12-b0a5-a2ab1d5eeb51 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c5ff9d0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:59.577289 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f9765833-c18b-4c12-b0a5-a2ab1d5eeb51 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.108499 Sep 16 03:55:59.577989 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 495/985] 10.222.0.49 () {58 vars in 1149 bytes} [Fri Sep 16 03:55:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:59.591551 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9b46fc77-e004-4a68-b80a-8cb6ddc50795 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c676670>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:59.682660 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9b46fc77-e004-4a68-b80a-8cb6ddc50795 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094861 Sep 16 03:55:59.683549 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 491/986] 10.222.0.49 () {58 vars in 1134 bytes} [Fri Sep 16 03:55:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:55:59.697489 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f4ee5092-9ee4-41d9-bc11-3461f3d6ea4c tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c5dc820>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:59.790432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f4ee5092-9ee4-41d9-bc11-3461f3d6ea4c tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097237 Sep 16 03:55:59.791300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 496/987] 10.222.0.49 () {58 vars in 1167 bytes} [Fri Sep 16 03:55:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:59.821978 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b0cbd7b5-099c-4e0e-b06a-2138c5282405 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c5aaee0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:55:59.934498 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b0cbd7b5-099c-4e0e-b06a-2138c5282405 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128815 Sep 16 03:55:59.935096 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 492/988] 10.222.0.49 () {58 vars in 1170 bytes} [Fri Sep 16 03:55:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:55:59.950023 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a1438ce7-eb97-4e9c-a505-47cf8659448a tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c5ac280>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:00.049388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a1438ce7-eb97-4e9c-a505-47cf8659448a tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.102885 Sep 16 03:56:00.055166 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 497/989] 10.222.0.49 () {58 vars in 1155 bytes} [Fri Sep 16 03:55:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:56:00.064227 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-03518b79-63b1-4b1a-9bc2-2d184eb0b0ab tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c72c550>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:00.146980 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-03518b79-63b1-4b1a-9bc2-2d184eb0b0ab tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087047 Sep 16 03:56:00.155313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 493/990] 10.222.0.49 () {58 vars in 1188 bytes} [Fri Sep 16 03:56:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:00.162559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ff5fc4f2-29c0-4044-afc0-f8702a7b5276 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] Calling method '.version_select at 0x7fba7c5ecee0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:00.275744 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ff5fc4f2-29c0-4044-afc0-f8702a7b5276 tempest-VolumesTestJSON-1962669622 tempest-VolumesTestJSON-1962669622-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.117091 Sep 16 03:56:00.286948 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 498/991] 10.222.0.49 () {58 vars in 1155 bytes} [Fri Sep 16 03:56:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:56:09.391584 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:09.392340 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=37 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:09.396448 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:09.398588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:09.405112 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:09.405595 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:09.406031 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:09.407248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:09.407248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:09.407596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:09.438012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cc6a7cbc-1de8-4bb4-b4ba-7afd4fcd27ac tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047664 Sep 16 03:56:09.438574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 494/992] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 16 03:56:09 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:56:09.500144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:09.500891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=18 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:09.504956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:09.505362 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:09.513576 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:09.513576 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:09.513576 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:09.513576 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:09.513929 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:09.514205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:09.542838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:56:09.843177 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7558cf56-dbf9-47b9-a29a-3d5f1ff19343 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 204 len: 0 microversion: 2.20 time: 0.344100 Sep 16 03:56:09.843968 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 499/993] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Sep 16 03:56:09 2022] DELETE /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 03:56:09.852732 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:09.853417 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:09.860245 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:09.860723 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:09.861153 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:09.861839 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:09.862280 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:09.862697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:09.999383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:10.007605 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:10.009047 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:10.014366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d35339c3-1bee-4b84-bf5c-73a11886f8f1 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.162074 Sep 16 03:56:10.014366 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 495/994] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:56:09 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:56:11.038587 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:11.039311 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:11.046314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:11.046795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:11.047283 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:11.047974 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:11.048433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:11.048850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:11.181304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:11.189944 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:11.191427 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:11.192595 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b54d75c0-ce75-47de-a495-85ad1dd4a853 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1721 microversion: 2.20 time: 0.158321 Sep 16 03:56:11.193145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 500/995] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:56:11 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:56:12.221889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:12.222492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:12.225992 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-54fd1b57-3614-4ce8-831a-96e5a5bf48e6 req-c437c8c2-4f74-4b21-bd67-6cf9ee0ab02d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2263def2-54ff-4255-a751-2bdb7e32db67", "name": "network-vif-deleted", "tag": "68bc6748-c4d5-4935-8d58-9b9bd27239ad"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:56:12.229953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:12.232430 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:12.232430 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:12.232430 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:12.232430 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:12.232776 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:12.238008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-54fd1b57-3614-4ce8-831a-96e5a5bf48e6 req-c437c8c2-4f74-4b21-bd67-6cf9ee0ab02d service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:12.238890 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-54fd1b57-3614-4ce8-831a-96e5a5bf48e6 req-c437c8c2-4f74-4b21-bd67-6cf9ee0ab02d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:12.239437 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-54fd1b57-3614-4ce8-831a-96e5a5bf48e6 req-c437c8c2-4f74-4b21-bd67-6cf9ee0ab02d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:12.254311 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-54fd1b57-3614-4ce8-831a-96e5a5bf48e6 req-c437c8c2-4f74-4b21-bd67-6cf9ee0ab02d service nova] Creating event network-vif-deleted:68bc6748-c4d5-4935-8d58-9b9bd27239ad for instance 2263def2-54ff-4255-a751-2bdb7e32db67 on hv-cinder-85799 Sep 16 03:56:12.260867 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-54fd1b57-3614-4ce8-831a-96e5a5bf48e6 req-c437c8c2-4f74-4b21-bd67-6cf9ee0ab02d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040213 Sep 16 03:56:12.261742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 501/996] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:56:12.304009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:12.314461 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:12.316240 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416479ba056f4612b6214cf115251269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb698ddcedae42a29f50203ec59db295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:12.317602 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-db2c1d65-84a6-4a18-bb7e-9ad0da7d4fd0 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 200 len: 1654 microversion: 2.20 time: 0.100531 Sep 16 03:56:12.318332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 496/997] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:56:12 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 1654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 03:56:13.345432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:13.346126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:13.353568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:13.360008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:13.360008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:13.360008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:13.360008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:13.360635 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:13.371040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] HTTP exception thrown: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Request method failure captured: Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 HTTP/1.1 Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_INlXgauEO6bUP-GJLsPv1cPbNKSOTbGOP8XYGB4h5SHFL1AwIMChoUNrykJc4TDPoqZ-uFOLU8mg0d95oc_qrYpErkRfVmDEXXQSJdGUgmh9Q8Vu1dr3gR2hIIsc39BziuBtYBK8I9dtpGsqR6pe8ZysuqFylTjRMfZmKBPTiVFpo Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:56:13.372715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb698ddcedae42a29f50203ec59db295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}] Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 416479ba056f4612b6214cf115251269 Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:13.374451 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '2263def2-54ff-4255-a751-2bdb7e32db67'} Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:13.375690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:13.377192 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:13.378773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Returning 404 to user: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:13.378773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c445fa0a-ca46-4802-be4d-1dcef8234995 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 404 len: 111 microversion: 2.20 time: 0.033453 Sep 16 03:56:13.378773 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 502/998] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:56:13 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:56:13.383684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6681ddad-5b84-4e85-bbe8-4742b6eafc33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '.version_select at 0x7fba7c794ee0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:13.541967 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6681ddad-5b84-4e85-bbe8-4742b6eafc33 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038194499" status: 204 len: 0 microversion: 2.20 time: 0.162618 Sep 16 03:56:13.542543 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 497/999] 10.222.0.49 () {60 vars in 1262 bytes} [Fri Sep 16 03:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038194499 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 03:56:16.682417 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:16.683006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:16.689544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:16.690026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:16.693614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:16.693614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:16.693614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:16.693614 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:16.706302 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] HTTP exception thrown: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Request method failure captured: Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 HTTP/1.1 Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_INlXgauEO6bUP-GJLsPv1cPbNKSOTbGOP8XYGB4h5SHFL1AwIMChoUNrykJc4TDPoqZ-uFOLU8mg0d95oc_qrYpErkRfVmDEXXQSJdGUgmh9Q8Vu1dr3gR2hIIsc39BziuBtYBK8I9dtpGsqR6pe8ZysuqFylTjRMfZmKBPTiVFpo Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:56:16.707881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb698ddcedae42a29f50203ec59db295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}] Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 416479ba056f4612b6214cf115251269 Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.709523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '2263def2-54ff-4255-a751-2bdb7e32db67'} Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:16.710493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.712229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.713627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Returning 404 to user: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:16.713627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-672b8cc7-0f99-415f-80ab-6850a63a6db4 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 404 len: 111 microversion: 2.20 time: 0.031314 Sep 16 03:56:16.713627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 503/1000] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Sep 16 03:56:16 2022] DELETE /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:56:16.718674 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:16.719306 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 2263def2-54ff-4255-a751-2bdb7e32db67] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:16.725911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:16.728384 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:16.728384 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:16.728384 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:16.728384 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:16.728768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:16.741788 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] HTTP exception thrown: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Request method failure captured: Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 HTTP/1.1 Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_INlXgauEO6bUP-GJLsPv1cPbNKSOTbGOP8XYGB4h5SHFL1AwIMChoUNrykJc4TDPoqZ-uFOLU8mg0d95oc_qrYpErkRfVmDEXXQSJdGUgmh9Q8Vu1dr3gR2hIIsc39BziuBtYBK8I9dtpGsqR6pe8ZysuqFylTjRMfZmKBPTiVFpo Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:56:16.744520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb698ddcedae42a29f50203ec59db295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}] Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: 416479ba056f4612b6214cf115251269 Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.746239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '2263def2-54ff-4255-a751-2bdb7e32db67'} Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:16.747238 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. Sep 16 03:56:16.749442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:16.757610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Returning 404 to user: Instance 2263def2-54ff-4255-a751-2bdb7e32db67 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:16.757610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fa274bc6-dce9-4eb0-b6a6-b3ef45a92b56 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67" status: 404 len: 111 microversion: 2.20 time: 0.031858 Sep 16 03:56:16.757610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 498/1001] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:56:16 2022] GET /compute/v2.1/servers/2263def2-54ff-4255-a751-2bdb7e32db67 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:56:18.040129 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:18.040929 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:18.048314 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:18.049898 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:18.049898 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:18.050374 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:18.050570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:18.051024 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:18.067305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] HTTP exception thrown: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Request method failure captured: Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b HTTP/1.1 Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_INlXgauEO6bUP-GJLsPv1cPbNKSOTbGOP8XYGB4h5SHFL1AwIMChoUNrykJc4TDPoqZ-uFOLU8mg0d95oc_qrYpErkRfVmDEXXQSJdGUgmh9Q8Vu1dr3gR2hIIsc39BziuBtYBK8I9dtpGsqR6pe8ZysuqFylTjRMfZmKBPTiVFpo Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:56:18.069285 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb698ddcedae42a29f50203ec59db295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}] Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 416479ba056f4612b6214cf115251269 Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.071913 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '230b59e9-09d0-4448-a6a6-a395823fcd8b'} Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:18.072961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.074370 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.076095 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Returning 404 to user: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:18.077037 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-31c17496-6f61-4f20-a337-7fbb87a6396c tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 404 len: 111 microversion: 2.20 time: 0.041055 Sep 16 03:56:18.077837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 504/1002] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Sep 16 03:56:18 2022] DELETE /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:56:18.097429 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:18.098138 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] [instance: 230b59e9-09d0-4448-a6a6-a395823fcd8b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:18.104783 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:18.105255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:18.105684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:18.106450 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:18.106927 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:18.107353 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:18.123758 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] HTTP exception thrown: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Request method failure captured: Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b HTTP/1.1 Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_INlXgauEO6bUP-GJLsPv1cPbNKSOTbGOP8XYGB4h5SHFL1AwIMChoUNrykJc4TDPoqZ-uFOLU8mg0d95oc_qrYpErkRfVmDEXXQSJdGUgmh9Q8Vu1dr3gR2hIIsc39BziuBtYBK8I9dtpGsqR6pe8ZysuqFylTjRMfZmKBPTiVFpo Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:56:18.125310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb698ddcedae42a29f50203ec59db295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb698ddcedae42a29f50203ec59db295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb698ddcedae42a29f50203ec59db295"}]}] Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: cb698ddcedae42a29f50203ec59db295 Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2073451032 Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: 416479ba056f4612b6214cf115251269 Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2073451032-project Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.127065 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '230b59e9-09d0-4448-a6a6-a395823fcd8b'} Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:18.127882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. Sep 16 03:56:18.129352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:18.131083 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] Returning 404 to user: Instance 230b59e9-09d0-4448-a6a6-a395823fcd8b could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:18.131083 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b4565123-3351-4119-95b5-f7c296f8bb34 tempest-AttachVolumeShelveTestJSON-2073451032 tempest-AttachVolumeShelveTestJSON-2073451032-project] 10.222.0.49 "GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b" status: 404 len: 111 microversion: 2.20 time: 0.033697 Sep 16 03:56:18.131083 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 499/1003] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 16 03:56:18 2022] GET /compute/v2.1/servers/230b59e9-09d0-4448-a6a6-a395823fcd8b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 03:56:24.693253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2b8cad9f-6ed6-42f8-a8ea-ae7dc1e2fbf8 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Action: 'create', calling method: .version_select at 0x7fba7c5ffdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-312636618"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:56:25.563929 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2b8cad9f-6ed6-42f8-a8ea-ae7dc1e2fbf8 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.033847 Sep 16 03:56:25.564566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 505/1004] 10.222.0.49 () {60 vars in 1155 bytes} [Fri Sep 16 03:56:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1035 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 16 03:56:25.578046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-afbd1388-f33d-4388-84d3-80de519830a5 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7d8659d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:25.632865 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-afbd1388-f33d-4388-84d3-80de519830a5 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7" status: 200 len: 344 microversion: 2.1 time: 0.054208 Sep 16 03:56:25.632865 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 500/1005] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:56:25 2022] GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:56:26.645194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a9f7706e-a3bc-4fdc-92f5-3a84667f78ac tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c5b2670>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:26.700286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a9f7706e-a3bc-4fdc-92f5-3a84667f78ac tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7" status: 200 len: 345 microversion: 2.1 time: 0.058959 Sep 16 03:56:26.708998 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 506/1006] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:56:26 2022] GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:26.715538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2a861240-568d-4bb9-a63e-19ffcecec343 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Action: 'create', calling method: .version_select at 0x7fba7c78d5e0>, body: {"snapshot": {"volume_id": "fa693e58-176b-42e7-a1bd-a4c320c8f1d7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-892930556"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:56:27.214132 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2a861240-568d-4bb9-a63e-19ffcecec343 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.499559 Sep 16 03:56:27.214132 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 501/1007] 10.222.0.49 () {60 vars in 1162 bytes} [Fri Sep 16 03:56:26 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:27.222191 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9d1491d9-848c-4ac2-a061-8cc9cbd2154b tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c4dfc10>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:27.272507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9d1491d9-848c-4ac2-a061-8cc9cbd2154b tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 200 len: 286 microversion: 2.1 time: 0.040742 Sep 16 03:56:27.272507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 507/1008] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:56:27 2022] GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:27.283756 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-66b7b0ac-a45c-41e1-a568-45e258a1e592 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c676dc0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:27.317062 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-66b7b0ac-a45c-41e1-a568-45e258a1e592 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038101 Sep 16 03:56:27.317842 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 502/1009] 10.222.0.49 () {58 vars in 1140 bytes} [Fri Sep 16 03:56:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:27.331687 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-63a0d346-7ea0-4d4a-b420-36ba99899ae7 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7cae0f70>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:27.363724 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-63a0d346-7ea0-4d4a-b420-36ba99899ae7 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 200 len: 286 microversion: 2.1 time: 0.036111 Sep 16 03:56:27.364286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 508/1010] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:56:27 2022] GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:28.375046 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:28.375785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=22 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:28.379859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70b2f90e-edf9-466a-826a-7f85328f26cb tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c794280>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:28.412831 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-70b2f90e-edf9-466a-826a-7f85328f26cb tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 200 len: 286 microversion: 2.1 time: 0.038745 Sep 16 03:56:28.417921 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 503/1011] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:56:28 2022] GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:29.422749 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:29.423629 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:29.427498 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9cac84e3-b5dd-4c04-a4a6-7ad5cbba2a14 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c5ff1f0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:29.459584 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9cac84e3-b5dd-4c04-a4a6-7ad5cbba2a14 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 200 len: 286 microversion: 2.1 time: 0.038000 Sep 16 03:56:29.460151 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 509/1012] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:56:29 2022] GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:30.473354 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b767b0d8-6b1b-42e0-be9d-848ac404ae5c tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7ca29ca0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:30.504722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b767b0d8-6b1b-42e0-be9d-848ac404ae5c tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 200 len: 286 microversion: 2.1 time: 0.034980 Sep 16 03:56:30.505159 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 504/1013] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:56:30 2022] GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:30.597438 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1473006154"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:56:30.597984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:30.605486 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:30.606093 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:30.606530 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:30.607465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:30.611966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:30.611966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:30.751702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.network.security_group_api [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Removing security group c830a2df-df47-4808-b092-e0cf71ac7b80 from port 29237f39-1732-4b4a-81d4-300640dd2721 Sep 16 03:56:31.470201 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d55dac01-3106-43e3-b1d0-56893b006441 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "POST /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/action" status: 202 len: 0 microversion: 2.1 time: 0.877335 Sep 16 03:56:31.473805 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 510/1014] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 16 03:56:30 2022] POST /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/action => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 03:56:31.486335 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-8d6324a0-7351-410c-a2f8-08289d08abf1 req-e4786384-314e-4a77-955d-c59517e77a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cedd5c-2825-4c90-81bd-9300e1db80c9", "tag": "29237f39-1732-4b4a-81d4-300640dd2721"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:56:31.508643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8d6324a0-7351-410c-a2f8-08289d08abf1 req-e4786384-314e-4a77-955d-c59517e77a72 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:31.512953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8d6324a0-7351-410c-a2f8-08289d08abf1 req-e4786384-314e-4a77-955d-c59517e77a72 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:31.518978 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9ca995cf-dcbe-4a2e-b387-0cfb1a834305 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c5b2550>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:31.525393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8d6324a0-7351-410c-a2f8-08289d08abf1 req-e4786384-314e-4a77-955d-c59517e77a72 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:31.549429 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-8d6324a0-7351-410c-a2f8-08289d08abf1 req-e4786384-314e-4a77-955d-c59517e77a72 service nova] Creating event network-changed:29237f39-1732-4b4a-81d4-300640dd2721 for instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 on hv-cinder-85799 Sep 16 03:56:31.562780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9ca995cf-dcbe-4a2e-b387-0cfb1a834305 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 200 len: 287 microversion: 2.1 time: 0.048102 Sep 16 03:56:31.563367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 511/1015] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:56:31 2022] GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:56:31.570493 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-8d6324a0-7351-410c-a2f8-08289d08abf1 req-e4786384-314e-4a77-955d-c59517e77a72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090299 Sep 16 03:56:31.571537 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 505/1016] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:31.576621 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b3347d29-ac3d-4740-9ad5-9e2db3b09a6d tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c6398b0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:32.016395 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b3347d29-ac3d-4740-9ad5-9e2db3b09a6d tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 202 len: 0 microversion: 2.1 time: 0.443740 Sep 16 03:56:32.017105 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 512/1017] 10.222.0.49 () {58 vars in 1254 bytes} [Fri Sep 16 03:56:31 2022] DELETE /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 03:56:32.025950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-af40eae8-77c0-48a7-af0a-0a612058c906 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c7d4160>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:32.061999 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-af40eae8-77c0-48a7-af0a-0a612058c906 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 200 len: 286 microversion: 2.1 time: 0.038713 Sep 16 03:56:32.061999 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 506/1018] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:56:32 2022] GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:33.050550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:33.051090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:33.058173 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:33.059319 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:33.060726 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:33.061638 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:33.062109 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:33.062539 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:33.078061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d18bff87-76d2-42e5-8029-8509f99928c5 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c7943a0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:33.134107 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-d18bff87-76d2-42e5-8029-8509f99928c5 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] HTTP exception thrown: Snapshot fc5bfd36-7118-4938-b77a-a08575bbe98e could not be found. Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d18bff87-76d2-42e5-8029-8509f99928c5 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Request method failure captured: Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e HTTP/1.1 Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_Po9Obv94-t80_6iUFqoqkKAKtSXyh9_mozx_Cg6U3ms6L_ICg-V77F2AZ4ZfB8pgFfRfGWq9iwyHBxs8meiXjlSYV6e34WJdRpGM3xgCn8o-sfuPtsk8unXEPEf9jaiDEju9CySwcs1DjjsqomwqSYg2jatXiQ1sLTlF3t0eSxsbU Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: fb7f1e80fe074809bc81d3b9c98d0e2e Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:56:33.136521 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}] Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: fb7f1e80fe074809bc81d3b9c98d0e2e Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesSnapshotsTestJSON-534953686-project Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: cbae7d1df881469f97348d037e3d2ec2 Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-534953686-project Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Snapshot fc5bfd36-7118-4938-b77a-a08575bbe98e could not be found. Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'fc5bfd36-7118-4938-b77a-a08575bbe98e'} Sep 16 03:56:33.138406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fc5bfd36-7118-4938-b77a-a08575bbe98e could not be found. (HTTP 404) (Request-ID: req-d3016fd6-7a02-482e-a03c-9da722017c92) Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:33.144912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:56:33.146612 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fc5bfd36-7118-4938-b77a-a08575bbe98e could not be found. Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 16 03:56:33.148145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fc5bfd36-7118-4938-b77a-a08575bbe98e could not be found. Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fc5bfd36-7118-4938-b77a-a08575bbe98e could not be found. Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d18bff87-76d2-42e5-8029-8509f99928c5 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Returning 404 to user: Snapshot fc5bfd36-7118-4938-b77a-a08575bbe98e could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:33.149590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d18bff87-76d2-42e5-8029-8509f99928c5 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e" status: 404 len: 111 microversion: 2.1 time: 0.068343 Sep 16 03:56:33.150632 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 507/1019] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 16 03:56:33 2022] GET /compute/v2.1/os-snapshots/fc5bfd36-7118-4938-b77a-a08575bbe98e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:56:33.156413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6d336282-dd0d-4839-ac3a-61e03fed97d3 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c7439d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:33.229564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lazy-loading 'services' on Instance uuid b8cedd5c-2825-4c90-81bd-9300e1db80c9 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:56:33.466978 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6d336282-dd0d-4839-ac3a-61e03fed97d3 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7" status: 202 len: 0 microversion: 2.1 time: 0.322433 Sep 16 03:56:33.470393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 508/1020] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:56:33 2022] DELETE /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 03:56:33.476773 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e84dc5e6-699b-4f5b-836f-fd6388171a6f tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c7d44c0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:33.545712 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e84dc5e6-699b-4f5b-836f-fd6388171a6f tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7" status: 200 len: 344 microversion: 2.1 time: 0.073049 Sep 16 03:56:33.546289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 509/1021] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:56:33 2022] GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:33.595577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-99c5bd95-79df-4172-b1ca-8c4088d018e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments/2f826dd1-9958-4e4a-be28-9fe84aa0e27a" status: 202 len: 0 microversion: 2.1 time: 0.550193 Sep 16 03:56:33.595577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 513/1022] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:56:33 2022] DELETE /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments/2f826dd1-9958-4e4a-be28-9fe84aa0e27a => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:56:33.600197 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b1649d31-ad0d-4b41-938c-e0177b78ec60 req-54c840c1-28bf-439f-8a31-88bb0d3f9fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cedd5c-2825-4c90-81bd-9300e1db80c9", "tag": "29237f39-1732-4b4a-81d4-300640dd2721"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:56:33.609980 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:33.612377 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:33.619686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:33.620181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:33.620623 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:33.621323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:33.621776 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:33.622193 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:33.632068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b1649d31-ad0d-4b41-938c-e0177b78ec60 req-54c840c1-28bf-439f-8a31-88bb0d3f9fa3 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:33.632508 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b1649d31-ad0d-4b41-938c-e0177b78ec60 req-54c840c1-28bf-439f-8a31-88bb0d3f9fa3 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:33.632998 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b1649d31-ad0d-4b41-938c-e0177b78ec60 req-54c840c1-28bf-439f-8a31-88bb0d3f9fa3 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:33.646526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b1649d31-ad0d-4b41-938c-e0177b78ec60 req-54c840c1-28bf-439f-8a31-88bb0d3f9fa3 service nova] Creating event network-changed:29237f39-1732-4b4a-81d4-300640dd2721 for instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 on hv-cinder-85799 Sep 16 03:56:33.652189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b1649d31-ad0d-4b41-938c-e0177b78ec60 req-54c840c1-28bf-439f-8a31-88bb0d3f9fa3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064111 Sep 16 03:56:33.654131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 510/1023] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:33.692201 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7ea99ca2-f54c-4452-bffc-e30e5b5f9e46 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091809 Sep 16 03:56:33.692792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 514/1024] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:56:33 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:56:34.562117 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10d65280-8363-43bd-9bc6-4ead473d1412 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c7940d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:34.592933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-10d65280-8363-43bd-9bc6-4ead473d1412 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] HTTP exception thrown: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10d65280-8363-43bd-9bc6-4ead473d1412 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Request method failure captured: Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 HTTP/1.1 Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_Po9Obv94-t80_6iUFqoqkKAKtSXyh9_mozx_Cg6U3ms6L_ICg-V77F2AZ4ZfB8pgFfRfGWq9iwyHBxs8meiXjlSYV6e34WJdRpGM3xgCn8o-sfuPtsk8unXEPEf9jaiDEju9CySwcs1DjjsqomwqSYg2jatXiQ1sLTlF3t0eSxsbU Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: fb7f1e80fe074809bc81d3b9c98d0e2e Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:56:34.596190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}] Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: fb7f1e80fe074809bc81d3b9c98d0e2e Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesSnapshotsTestJSON-534953686-project Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: cbae7d1df881469f97348d037e3d2ec2 Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-534953686-project Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'fa693e58-176b-42e7-a1bd-a4c320c8f1d7'} Sep 16 03:56:34.597975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. (HTTP 404) (Request-ID: req-d50ece03-5d1b-4246-8fc5-742d9518673a) Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.599253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:56:34.607959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 03:56:34.609389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10d65280-8363-43bd-9bc6-4ead473d1412 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Returning 404 to user: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-10d65280-8363-43bd-9bc6-4ead473d1412 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7" status: 404 len: 109 microversion: 2.1 time: 0.041120 Sep 16 03:56:34.610941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 511/1025] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:56:34 2022] GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:56:34.614636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-36ccb639-d25d-4d1d-9e17-f2e202f5fa72 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c6f39d0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:34.656002 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-36ccb639-d25d-4d1d-9e17-f2e202f5fa72 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] HTTP exception thrown: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-36ccb639-d25d-4d1d-9e17-f2e202f5fa72 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Request method failure captured: Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 HTTP/1.1 Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_Po9Obv94-t80_6iUFqoqkKAKtSXyh9_mozx_Cg6U3ms6L_ICg-V77F2AZ4ZfB8pgFfRfGWq9iwyHBxs8meiXjlSYV6e34WJdRpGM3xgCn8o-sfuPtsk8unXEPEf9jaiDEju9CySwcs1DjjsqomwqSYg2jatXiQ1sLTlF3t0eSxsbU Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: fb7f1e80fe074809bc81d3b9c98d0e2e Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:56:34.658385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}] Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: fb7f1e80fe074809bc81d3b9c98d0e2e Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotsTestJSON-534953686-project Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: cbae7d1df881469f97348d037e3d2ec2 Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotsTestJSON-534953686-project Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'fa693e58-176b-42e7-a1bd-a4c320c8f1d7'} Sep 16 03:56:34.660072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. (HTTP 404) (Request-ID: req-5494624c-21cf-4ac1-9efc-d144939db559) Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.663514 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 03:56:34.665028 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 03:56:34.666551 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-36ccb639-d25d-4d1d-9e17-f2e202f5fa72 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Returning 404 to user: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-36ccb639-d25d-4d1d-9e17-f2e202f5fa72 tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7" status: 404 len: 109 microversion: 2.1 time: 0.050943 Sep 16 03:56:34.669588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 515/1026] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 16 03:56:34 2022] DELETE /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:56:34.679179 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9aa39743-9dd8-4fdc-b42f-5490a660499a tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Calling method '.version_select at 0x7fba7c7d4940>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:34.707099 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-9aa39743-9dd8-4fdc-b42f-5490a660499a tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] HTTP exception thrown: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.709118 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9aa39743-9dd8-4fdc-b42f-5490a660499a tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Request method failure captured: Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 HTTP/1.1 Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_Po9Obv94-t80_6iUFqoqkKAKtSXyh9_mozx_Cg6U3ms6L_ICg-V77F2AZ4ZfB8pgFfRfGWq9iwyHBxs8meiXjlSYV6e34WJdRpGM3xgCn8o-sfuPtsk8unXEPEf9jaiDEju9CySwcs1DjjsqomwqSYg2jatXiQ1sLTlF3t0eSxsbU Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: fb7f1e80fe074809bc81d3b9c98d0e2e Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:56:34.709339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb7f1e80fe074809bc81d3b9c98d0e2e"}]}] Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: fb7f1e80fe074809bc81d3b9c98d0e2e Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-534953686 Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesSnapshotsTestJSON-534953686-project Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: cbae7d1df881469f97348d037e3d2ec2 Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-534953686-project Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'fa693e58-176b-42e7-a1bd-a4c320c8f1d7'} Sep 16 03:56:34.710706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. (HTTP 404) (Request-ID: req-70c0d539-c188-4379-8a6a-5543386a3a38) Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.711601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 03:56:34.713089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 03:56:34.714828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9aa39743-9dd8-4fdc-b42f-5490a660499a tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] Returning 404 to user: Volume fa693e58-176b-42e7-a1bd-a4c320c8f1d7 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:34.717109 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9aa39743-9dd8-4fdc-b42f-5490a660499a tempest-VolumesSnapshotsTestJSON-534953686 tempest-VolumesSnapshotsTestJSON-534953686-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7" status: 404 len: 109 microversion: 2.1 time: 0.045270 Sep 16 03:56:34.720353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:34.720492 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 512/1027] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 16 03:56:34 2022] GET /compute/v2.1/os-volumes/fa693e58-176b-42e7-a1bd-a4c320c8f1d7 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:56:34.720837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:34.721408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:34.721846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:34.722554 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:34.723034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:34.723481 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:34.758732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-befb4e2d-17b7-4f96-9dec-189547f8f279 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056768 Sep 16 03:56:34.759599 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 516/1028] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:56:34 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:56:35.772670 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:35.775826 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:35.784562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:35.785047 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:35.785475 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:35.786169 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:35.786614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:35.787064 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:35.822315 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1c4e158c-ea00-4e46-bccf-90874a675f19 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054424 Sep 16 03:56:35.823143 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 513/1029] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 16 03:56:35 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 03:56:35.835373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:35.835373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:35.842003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:35.842482 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:35.842929 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:35.843615 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:35.844062 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:35.844479 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:35.919824 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] HTTP exception thrown: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 is not attached to volume 2f826dd1-9958-4e4a-be28-9fe84aa0e27a Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Request method failure captured: Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments/2f826dd1-9958-4e4a-be28-9fe84aa0e27a HTTP/1.1 Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_NfGRUoie1kkPyCuCSsykSXlWdZSYYv1ORI-xxfHB51VzQ3oht1Y31ZCHR3iuL0H4Z03qPl8aTIqKqtz9EYQA0iVIxivRAcM3KccFRUzb6XcR2CF7bKkUEeMDhahbg0yy_nmsjg6IamgqFfCs697B5VJ-bcPGA74vzbSvqybHq_RqA Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: c705c2f92c1646dba9c11aa6000166bc Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestMinimumBasicScenario-950069111 Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:56:35.926049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c705c2f92c1646dba9c11aa6000166bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c705c2f92c1646dba9c11aa6000166bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c705c2f92c1646dba9c11aa6000166bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c705c2f92c1646dba9c11aa6000166bc"}]}] Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestMinimumBasicScenario-950069111 Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: c705c2f92c1646dba9c11aa6000166bc Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestMinimumBasicScenario-950069111 Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-TestMinimumBasicScenario-950069111-project Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 269dbbd6d926496d8c5c704832de5763 Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestMinimumBasicScenario-950069111-project Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:56:35.927698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 is not attached to volume 2f826dd1-9958-4e4a-be28-9fe84aa0e27a Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': 'b8cedd5c-2825-4c90-81bd-9300e1db80c9', 'id': '2f826dd1-9958-4e4a-be28-9fe84aa0e27a'} Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2f826dd1-9958-4e4a-be28-9fe84aa0e27a. Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:35.928523 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 is not attached to volume 2f826dd1-9958-4e4a-be28-9fe84aa0e27a Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 is not attached to volume 2f826dd1-9958-4e4a-be28-9fe84aa0e27a Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:56:35.929970 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Returning 404 to user: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 is not attached to volume 2f826dd1-9958-4e4a-be28-9fe84aa0e27a {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:35.931217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1d52c9b3-3e1e-45ad-99d0-06c54032e3e7 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments/2f826dd1-9958-4e4a-be28-9fe84aa0e27a" status: 404 len: 154 microversion: 2.1 time: 0.097148 Sep 16 03:56:35.931217 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 517/1030] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 16 03:56:35 2022] DELETE /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9/os-volume_attachments/2f826dd1-9958-4e4a-be28-9fe84aa0e27a => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:56:37.275975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:37.279352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:37.283684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:37.284656 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:37.285187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:37.285899 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:37.286351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:37.287054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:37.321782 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:56:37.621105 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-84dc930b-65aa-438e-887e-97c8b051761f tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 204 len: 0 microversion: 2.1 time: 0.348666 Sep 16 03:56:37.622351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 514/1031] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:56:37 2022] DELETE /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 03:56:37.633564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:37.634033 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:37.640092 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:37.640606 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:37.641668 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:37.642545 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:37.643186 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:37.647284 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:37.796107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:37.803898 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a425ccdb-0b2c-4c05-8839-c37271066fc4 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1555 microversion: 2.1 time: 0.176311 Sep 16 03:56:37.804601 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 518/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:56:37 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:56:38.832907 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:38.833697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:38.844348 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:38.845310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:38.846389 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:38.847890 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:38.848893 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:38.849712 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:39.087107 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:39.096964 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d497c8b7-955a-4b8b-93ff-1f07b751b906 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1555 microversion: 2.1 time: 0.269720 Sep 16 03:56:39.100473 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 515/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:56:38 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:56:40.119615 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:40.120441 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:40.127227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:40.127711 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:40.128142 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:40.128830 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:40.129276 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:40.129692 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:40.364103 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:40.377204 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-6779c1cd-479e-41d8-8bfa-b7652fb609fe req-129024e7-74d9-48ef-aad2-14b5792a1dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cedd5c-2825-4c90-81bd-9300e1db80c9", "name": "network-vif-deleted", "tag": "29237f39-1732-4b4a-81d4-300640dd2721"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:56:40.381632 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-23f40139-c04c-4676-803d-5a62723d9b6a tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1555 microversion: 2.1 time: 0.265845 Sep 16 03:56:40.398162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6779c1cd-479e-41d8-8bfa-b7652fb609fe req-129024e7-74d9-48ef-aad2-14b5792a1dff service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:40.398162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6779c1cd-479e-41d8-8bfa-b7652fb609fe req-129024e7-74d9-48ef-aad2-14b5792a1dff service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:40.398162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6779c1cd-479e-41d8-8bfa-b7652fb609fe req-129024e7-74d9-48ef-aad2-14b5792a1dff service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:40.398999 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 519/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:56:40 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1555 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:56:40.416495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-6779c1cd-479e-41d8-8bfa-b7652fb609fe req-129024e7-74d9-48ef-aad2-14b5792a1dff service nova] Creating event network-vif-deleted:29237f39-1732-4b4a-81d4-300640dd2721 for instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 on hv-cinder-85799 Sep 16 03:56:40.421892 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-6779c1cd-479e-41d8-8bfa-b7652fb609fe req-129024e7-74d9-48ef-aad2-14b5792a1dff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050412 Sep 16 03:56:40.422479 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 516/1035] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:56:41.406269 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:41.406875 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:41.413465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:41.413956 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:41.414389 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:41.415104 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:41.415552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:41.415972 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:41.452215 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:41.452747 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:41.453205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:41.453719 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lazy-loading 'fault' on Instance uuid b8cedd5c-2825-4c90-81bd-9300e1db80c9 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:56:41.509739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269dbbd6d926496d8c5c704832de5763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c705c2f92c1646dba9c11aa6000166bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:56:41.519085 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d6e4a6bf-5367-42bf-acd1-99a0ae92f693 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 200 len: 1348 microversion: 2.1 time: 0.117381 Sep 16 03:56:41.519987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 520/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:56:41 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 1348 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:56:42.549206 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:42.549944 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] [instance: b8cedd5c-2825-4c90-81bd-9300e1db80c9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:56:42.563698 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:42.566528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:42.566528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:42.566528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:56:42.566528 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:56:42.566941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:56:42.580848 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] HTTP exception thrown: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 could not be found. Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Request method failure captured: Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 HTTP/1.1 Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_NfGRUoie1kkPyCuCSsykSXlWdZSYYv1ORI-xxfHB51VzQ3oht1Y31ZCHR3iuL0H4Z03qPl8aTIqKqtz9EYQA0iVIxivRAcM3KccFRUzb6XcR2CF7bKkUEeMDhahbg0yy_nmsjg6IamgqFfCs697B5VJ-bcPGA74vzbSvqybHq_RqA Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: c705c2f92c1646dba9c11aa6000166bc Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestMinimumBasicScenario-950069111 Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:56:42.582490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c705c2f92c1646dba9c11aa6000166bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c705c2f92c1646dba9c11aa6000166bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c705c2f92c1646dba9c11aa6000166bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c705c2f92c1646dba9c11aa6000166bc"}]}] Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestMinimumBasicScenario-950069111 Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: c705c2f92c1646dba9c11aa6000166bc Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestMinimumBasicScenario-950069111 Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-TestMinimumBasicScenario-950069111-project Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: 269dbbd6d926496d8c5c704832de5763 Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestMinimumBasicScenario-950069111-project Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 could not be found. Sep 16 03:56:42.584191 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'b8cedd5c-2825-4c90-81bd-9300e1db80c9'} Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 could not be found. Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:56:42.585025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 could not be found. Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 could not be found. Sep 16 03:56:42.586474 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:56:42.588714 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Returning 404 to user: Instance b8cedd5c-2825-4c90-81bd-9300e1db80c9 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:56:42.588714 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-93a44b8f-8615-4c06-b535-a30b971e7e11 tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9" status: 404 len: 111 microversion: 2.1 time: 0.039874 Sep 16 03:56:42.588714 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 517/1037] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:56:42 2022] GET /compute/v2.1/servers/b8cedd5c-2825-4c90-81bd-9300e1db80c9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:56:42.595552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8c99a414-c4da-40bb-93d7-369d17097cab tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] Calling method '.version_select at 0x7fba7c639d30>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:56:42.730300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8c99a414-c4da-40bb-93d7-369d17097cab tempest-TestMinimumBasicScenario-950069111 tempest-TestMinimumBasicScenario-950069111-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-779987514" status: 202 len: 0 microversion: 2.1 time: 0.140987 Sep 16 03:56:42.731795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 521/1038] 10.222.0.49 () {58 vars in 1269 bytes} [Fri Sep 16 03:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-779987514 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 03:57:48.022628 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:57:48.023467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:57:48.024725 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 03:57:48.024861 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Fri Sep 16 03:57:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.49) !!! Sep 16 03:57:48.030615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1301234737", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "networks": [{"uuid": "0ec0daae-44e5-4b74-a88f-e18abd4b0197"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:57:48.092585 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] validate_networks() for [('0ec0daae-44e5-4b74-a88f-e18abd4b0197', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:57:48.698976 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:57:48.699337 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:57:48.699810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:57:48.700219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:57:48.700686 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:57:48.709396 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:48.709874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:48.710304 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:48.711697 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:48.712152 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:48.712597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:48.729014 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Getting quotas for project ada320ab9e1644f29fd613c173ffe0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:57:48.733052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Getting quotas for user 6794c30b34984af2b3eb6c0902a6157d and project ada320ab9e1644f29fd613c173ffe0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:57:48.744009 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:57:48.746319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:57:48.960350 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-986b2a6c-7d35-45ab-89b2-230d05f4379b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939506 Sep 16 03:57:48.961006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 518/1039] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:57:48.971323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:57:48.972833 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:57:48.973810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 03:57:48.974010 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Fri Sep 16 03:57:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 (ip 10.222.0.49) !!! Sep 16 03:57:48.980881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4ed48271-2c1c-405e-92e0-d7296287b470 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:48.981898 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4ed48271-2c1c-405e-92e0-d7296287b470 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:49.042084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ed48271-2c1c-405e-92e0-d7296287b470 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:49.049052 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4ed48271-2c1c-405e-92e0-d7296287b470 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1214 microversion: 2.1 time: 0.080472 Sep 16 03:57:49.049616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 522/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:48 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:50.074593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:50.075375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:50.082383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:50.083648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:50.083648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:50.084007 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:50.084457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:50.084881 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:50.148432 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:50.156346 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-938917df-009c-45d7-83bb-8f94eed7b94a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1218 microversion: 2.1 time: 0.086662 Sep 16 03:57:50.156911 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 519/1041] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:50 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:51.181426 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:51.182026 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:51.189860 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:51.190358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:51.190793 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:51.191622 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:51.192126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:51.192554 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:51.259749 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:51.268126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b5cbde7c-04f2-4751-b486-022f98c3b9bc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1266 microversion: 2.1 time: 0.091931 Sep 16 03:57:51.273896 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 523/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:51 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:52.291882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:52.292531 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:52.299075 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:52.299568 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:52.300005 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:52.300698 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:52.301167 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:52.301560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:52.438174 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:52.446541 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-876e75e5-9331-4562-82e3-ee50e7b531cb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1314 microversion: 2.1 time: 0.159432 Sep 16 03:57:52.447176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 520/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:52 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:53.283432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-689d56d9-83ba-4843-8872-d0059ac0c0d3 req-351831c9-2efa-4907-bb75-d67d131035ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3ca944-6ade-4511-8553-cbc54cc84434", "tag": "8448bb27-7e56-40d4-8858-19d7d66d4ab8"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:57:53.294522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-689d56d9-83ba-4843-8872-d0059ac0c0d3 req-351831c9-2efa-4907-bb75-d67d131035ef service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:53.295022 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-689d56d9-83ba-4843-8872-d0059ac0c0d3 req-351831c9-2efa-4907-bb75-d67d131035ef service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:53.295634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-689d56d9-83ba-4843-8872-d0059ac0c0d3 req-351831c9-2efa-4907-bb75-d67d131035ef service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:53.314768 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-689d56d9-83ba-4843-8872-d0059ac0c0d3 req-351831c9-2efa-4907-bb75-d67d131035ef service nova] Creating event network-changed:8448bb27-7e56-40d4-8858-19d7d66d4ab8 for instance 8e3ca944-6ade-4511-8553-cbc54cc84434 on hv-cinder-85799 Sep 16 03:57:53.328332 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-689d56d9-83ba-4843-8872-d0059ac0c0d3 req-351831c9-2efa-4907-bb75-d67d131035ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041011 Sep 16 03:57:53.328332 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 524/1044] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:57:53.477686 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:53.478425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:53.485142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:53.485743 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:53.486356 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:53.487161 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:53.488029 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:53.488185 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:53.650623 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:53.653295 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ec66d51f-f490-423d-b337-04e076cec2ea tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1314 microversion: 2.1 time: 0.180000 Sep 16 03:57:53.654534 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 521/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:53 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:54.677075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:54.677849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:54.684442 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:54.684934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:54.685639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:54.686336 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:54.686792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:54.687241 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:54.816875 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:54.824826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a3f9b30e-adff-44b6-aa46-a82952df9a33 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1314 microversion: 2.1 time: 0.152593 Sep 16 03:57:54.825388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 525/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:54 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:55.847696 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:55.848248 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:55.855268 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:55.855749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:55.856175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:55.856863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:55.857301 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:55.857715 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:55.997142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:56.005201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fedf7ab8-07e0-482d-9e40-a27930dfc03b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1314 microversion: 2.1 time: 0.161521 Sep 16 03:57:56.005954 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 522/1047] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:55 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:57.030111 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:57.030710 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:57.036921 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:57.037401 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:57.037831 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:57.038511 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:57.039493 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:57.039911 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:57.176881 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:57.186232 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5c505fc2-8f0d-434b-9d40-7d762690ff5d tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1314 microversion: 2.1 time: 0.160139 Sep 16 03:57:57.186813 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 526/1048] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:57 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:58.216608 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:58.217208 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:58.224028 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:58.224509 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:58.224940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:58.225626 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:58.226588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:58.227239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:58.361044 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:58.370070 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cf8b02aa-0198-46be-9424-bb15226ed78b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1314 microversion: 2.1 time: 0.157285 Sep 16 03:57:58.370672 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 523/1049] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:58 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:58.568075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-456395125", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:57:58.622305 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] validate_networks() for None {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:57:58.888114 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:57:58.888532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:57:58.888994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:57:58.889392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:57:58.889797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:57:58.899003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:58.899477 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:58.899905 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:58.900617 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:58.901061 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:58.901476 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:58.918126 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Getting quotas for project 548a2763e5c146c783f15114b4070a0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:57:58.922015 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Getting quotas for user a28d6bcc3a664d498d07890e2cab7f1a and project 548a2763e5c146c783f15114b4070a0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:57:58.932796 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:57:58.935048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:57:59.107234 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c80c57c5-d24e-4018-932c-14c55e1e312b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543001 Sep 16 03:57:59.108198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 527/1050] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:57:59.119491 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e2b01a1b-ea63-4210-9b9a-3e8936cbdae1 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:59.120111 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e2b01a1b-ea63-4210-9b9a-3e8936cbdae1 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:59.139457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:57:59.139457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:57:59.186746 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2b01a1b-ea63-4210-9b9a-3e8936cbdae1 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:59.193746 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e2b01a1b-ea63-4210-9b9a-3e8936cbdae1 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1214 microversion: 2.1 time: 0.078315 Sep 16 03:57:59.194342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 524/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:59 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:57:59.393238 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:57:59.393885 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:57:59.400244 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:59.400709 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:59.401141 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:59.401822 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:59.402266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:59.403917 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:59.423795 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-3d93fa14-e564-4398-aa85-f63e12848e29 req-c5880345-f5ef-4dbb-8468-3c79e9210e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3ca944-6ade-4511-8553-cbc54cc84434", "name": "network-vif-plugged", "status": "completed", "tag": "8448bb27-7e56-40d4-8858-19d7d66d4ab8"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:57:59.435597 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3d93fa14-e564-4398-aa85-f63e12848e29 req-c5880345-f5ef-4dbb-8468-3c79e9210e68 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:57:59.436081 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3d93fa14-e564-4398-aa85-f63e12848e29 req-c5880345-f5ef-4dbb-8468-3c79e9210e68 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:57:59.436507 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3d93fa14-e564-4398-aa85-f63e12848e29 req-c5880345-f5ef-4dbb-8468-3c79e9210e68 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:57:59.448110 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-3d93fa14-e564-4398-aa85-f63e12848e29 req-c5880345-f5ef-4dbb-8468-3c79e9210e68 service nova] Creating event network-vif-plugged:8448bb27-7e56-40d4-8858-19d7d66d4ab8 for instance 8e3ca944-6ade-4511-8553-cbc54cc84434 on hv-cinder-85799 Sep 16 03:57:59.453199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-3d93fa14-e564-4398-aa85-f63e12848e29 req-c5880345-f5ef-4dbb-8468-3c79e9210e68 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033256 Sep 16 03:57:59.453796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 525/1052] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:57:59.534855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:57:59.543006 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f7001d09-0ec6-4cc9-8557-04ec454f3070 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1314 microversion: 2.1 time: 0.153958 Sep 16 03:57:59.543586 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 528/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:57:59 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:00.219125 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ca4676f2-288b-4745-aa09-7a99b998e854 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:00.219857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ca4676f2-288b-4745-aa09-7a99b998e854 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:00.273182 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ca4676f2-288b-4745-aa09-7a99b998e854 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:00.281026 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ca4676f2-288b-4745-aa09-7a99b998e854 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1214 microversion: 2.1 time: 0.067019 Sep 16 03:58:00.281594 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 526/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:00 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:00.566848 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:00.567487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:00.574263 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:00.574748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:00.575225 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:00.575962 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:00.576416 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:00.576843 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:00.707580 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:00.715397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e98080e1-4d79-4d3c-a95e-a5fcdca168eb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1314 microversion: 2.1 time: 0.152449 Sep 16 03:58:00.715955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 529/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:00 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:01.304679 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:01.305284 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:01.312885 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:01.313367 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:01.313799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:01.314490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:01.314953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:01.315372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:01.377495 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:01.385580 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-856908fb-1ab4-4630-a6ee-34e75eb2069f tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1218 microversion: 2.1 time: 0.084744 Sep 16 03:58:01.386141 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 527/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:01 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:01.738961 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:01.739572 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:01.747456 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:01.747939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:01.748367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:01.749049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:01.749588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:01.750059 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:01.879068 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:01.886742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5bc723ae-7d3d-4c59-af3c-c16af9c206aa tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1499 microversion: 2.1 time: 0.151747 Sep 16 03:58:01.887343 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 530/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:01 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:02.408625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:02.409431 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:02.416966 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:02.417176 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:02.417607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:02.418300 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:02.418749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:02.419213 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:02.489919 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:02.499190 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1e47e58e-f7d5-48a5-b0ec-b17bf983777b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1274 microversion: 2.1 time: 0.094647 Sep 16 03:58:02.499769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 528/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:02 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:02.876067 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:02.876575 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:02.882938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:02.883453 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:02.883910 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:02.884954 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:02.885413 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:02.885840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:02.911143 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:58:03.206827 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0ebe7bb3-5a4e-46be-b86a-83d252894b5f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 204 len: 0 microversion: 2.1 time: 0.334066 Sep 16 03:58:03.215427 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 531/1059] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:58:02 2022] DELETE /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:58:03.216023 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:03.217060 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:03.223318 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:03.223806 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:03.224244 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:03.224948 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:03.225406 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:03.225833 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:03.380070 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:03.387502 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-df95779c-ad00-4f26-8bc1-b9ce31d29457 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1505 microversion: 2.1 time: 0.175978 Sep 16 03:58:03.388348 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 529/1060] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:03 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:03.524704 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:03.526061 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:03.532091 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:03.532573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:03.533002 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:03.533682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:03.534128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:03.534546 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:03.667693 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:03.675188 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b22b3f24-a24c-4066-b15c-5457ca0b5881 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1314 microversion: 2.1 time: 0.154723 Sep 16 03:58:03.675749 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 532/1061] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:03 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:04.411051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:04.411876 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:04.418938 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:04.423219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:04.423219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:04.423219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:04.423219 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:04.423651 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:04.565032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:04.573463 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5271d766-b756-44e2-b1b1-bd70dd95e19a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1505 microversion: 2.1 time: 0.166131 Sep 16 03:58:04.574297 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 530/1062] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:04 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:04.697507 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:04.698811 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:04.705654 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:04.706182 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:04.706648 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:04.707380 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:04.707840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:04.708293 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:04.936054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:04.944388 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bf36b268-6a10-4f56-8b15-0f0684730ae7 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1314 microversion: 2.1 time: 0.250655 Sep 16 03:58:04.951588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 533/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:04 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:05.186447 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-cf0d6db5-045d-4685-877d-b09966eb396b req-8e6b96e3-3651-4a83-add2-c2bd3cebe6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3ca944-6ade-4511-8553-cbc54cc84434", "name": "network-vif-deleted", "tag": "8448bb27-7e56-40d4-8858-19d7d66d4ab8"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:05.196853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cf0d6db5-045d-4685-877d-b09966eb396b req-8e6b96e3-3651-4a83-add2-c2bd3cebe6b3 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:05.197331 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cf0d6db5-045d-4685-877d-b09966eb396b req-8e6b96e3-3651-4a83-add2-c2bd3cebe6b3 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:05.197762 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cf0d6db5-045d-4685-877d-b09966eb396b req-8e6b96e3-3651-4a83-add2-c2bd3cebe6b3 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:05.210341 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-cf0d6db5-045d-4685-877d-b09966eb396b req-8e6b96e3-3651-4a83-add2-c2bd3cebe6b3 service nova] Creating event network-vif-deleted:8448bb27-7e56-40d4-8858-19d7d66d4ab8 for instance 8e3ca944-6ade-4511-8553-cbc54cc84434 on hv-cinder-85799 Sep 16 03:58:05.216187 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-cf0d6db5-045d-4685-877d-b09966eb396b req-8e6b96e3-3651-4a83-add2-c2bd3cebe6b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034765 Sep 16 03:58:05.217130 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 531/1064] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:58:05.233544 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-d6fea884-e9c5-4072-bede-3b9be4a39568 req-93044f19-8e2f-4077-b5bb-4d805d4607c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a4d2c5-b48d-4967-9a36-474f8806d840", "tag": "4f696dc9-c720-4565-95c8-fbe193a6732a"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:05.248696 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d6fea884-e9c5-4072-bede-3b9be4a39568 req-93044f19-8e2f-4077-b5bb-4d805d4607c7 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:05.250001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d6fea884-e9c5-4072-bede-3b9be4a39568 req-93044f19-8e2f-4077-b5bb-4d805d4607c7 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:05.250459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d6fea884-e9c5-4072-bede-3b9be4a39568 req-93044f19-8e2f-4077-b5bb-4d805d4607c7 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:05.265036 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-d6fea884-e9c5-4072-bede-3b9be4a39568 req-93044f19-8e2f-4077-b5bb-4d805d4607c7 service nova] Creating event network-changed:4f696dc9-c720-4565-95c8-fbe193a6732a for instance 93a4d2c5-b48d-4967-9a36-474f8806d840 on hv-cinder-85799 Sep 16 03:58:05.270602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-d6fea884-e9c5-4072-bede-3b9be4a39568 req-93044f19-8e2f-4077-b5bb-4d805d4607c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041052 Sep 16 03:58:05.271258 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 534/1065] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:58:05.602145 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:05.603222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:05.610661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:05.611277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:05.611945 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:05.612799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:05.613416 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:05.613910 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:05.652008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:05.652511 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:05.652953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:05.653413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lazy-loading 'fault' on Instance uuid 8e3ca944-6ade-4511-8553-cbc54cc84434 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:58:05.712676 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:05.722601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cca137a1-cb0e-4a46-8cb3-a2fdcbbd818c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 200 len: 1304 microversion: 2.1 time: 0.125748 Sep 16 03:58:05.735535 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 532/1066] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:05 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:05.970297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:05.971053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:05.977384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:05.977864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:05.978295 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:05.979014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:05.979976 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:05.980687 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:06.189010 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:06.196879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c9475504-7423-4ca7-a187-728ac6b7d859 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1314 microversion: 2.1 time: 0.231412 Sep 16 03:58:06.197448 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 535/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:05 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:06.748307 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:06.748849 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: 8e3ca944-6ade-4511-8553-cbc54cc84434] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:06.755323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:06.755799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:06.756227 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:06.756904 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:06.757351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:06.757770 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:06.771924 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] HTTP exception thrown: Instance 8e3ca944-6ade-4511-8553-cbc54cc84434 could not be found. Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Request method failure captured: Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 HTTP/1.1 Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_Q6AkTRxjKODJ_KwU95z129ie2ol8y_NKPPaF5TyDFlRQN9n8maLJf58B04DpPh7LkXVJ5yKtwbgG6ovKohQ8cDFOXT44--RXVGlxrR_AEhMRY0BUJZjCKKsgPAk9_Pfdte_WJkA3x6LLIOVEDLDUxgTbNxvaCJK4qrxLkcnVEZTmI Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: ada320ab9e1644f29fd613c173ffe0a8 Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesActionsTest-185621777 Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:58:06.773563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ada320ab9e1644f29fd613c173ffe0a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ada320ab9e1644f29fd613c173ffe0a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ada320ab9e1644f29fd613c173ffe0a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ada320ab9e1644f29fd613c173ffe0a8"}]}] Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesActionsTest-185621777 Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: ada320ab9e1644f29fd613c173ffe0a8 Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesActionsTest-185621777 Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesActionsTest-185621777-project Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: 6794c30b34984af2b3eb6c0902a6157d Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesActionsTest-185621777-project Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 8e3ca944-6ade-4511-8553-cbc54cc84434 could not be found. Sep 16 03:58:06.775319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '8e3ca944-6ade-4511-8553-cbc54cc84434'} Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3ca944-6ade-4511-8553-cbc54cc84434 could not be found. Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:58:06.776588 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3ca944-6ade-4511-8553-cbc54cc84434 could not be found. Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3ca944-6ade-4511-8553-cbc54cc84434 could not be found. Sep 16 03:58:06.778263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:06.779766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Returning 404 to user: Instance 8e3ca944-6ade-4511-8553-cbc54cc84434 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:58:06.779766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-576a858e-ca7c-4817-bff1-c4da5d389338 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434" status: 404 len: 111 microversion: 2.1 time: 0.031321 Sep 16 03:58:06.779766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 533/1068] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:06 2022] GET /compute/v2.1/servers/8e3ca944-6ade-4511-8553-cbc54cc84434 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:58:06.872405 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1416288740", "imageRef": "86fb5176-6251-49a4-abc7-3c72d16ebfbf", "flavorRef": "452", "networks": [{"uuid": "0ec0daae-44e5-4b74-a88f-e18abd4b0197"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:06.925088 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] validate_networks() for [('0ec0daae-44e5-4b74-a88f-e18abd4b0197', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:58:07.220681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:07.221446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:07.227359 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:07.227819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:07.228278 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:07.228969 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:07.229956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:07.230387 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:07.279795 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:58:07.280315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:58:07.280854 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:58:07.281237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:58:07.281736 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:58:07.290474 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:07.290985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:07.291434 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:07.292759 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:07.293227 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:07.293654 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:07.312085 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Getting quotas for project ada320ab9e1644f29fd613c173ffe0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:58:07.316174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Getting quotas for user 6794c30b34984af2b3eb6c0902a6157d and project ada320ab9e1644f29fd613c173ffe0a8. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:58:07.328101 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:58:07.330596 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86fb5176-6251-49a4-abc7-3c72d16ebfbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:58:07.370958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:07.378636 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-92e4e897-df82-454f-8607-22e7d6175071 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1314 microversion: 2.1 time: 0.161839 Sep 16 03:58:07.379231 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 534/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:07 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:58:07.488642 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2ff7d124-d464-478d-a747-0d6d0c4137a7 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620852 Sep 16 03:58:07.489287 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 536/1070] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:58:07.501418 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e882c67-da1f-4e99-a34f-ddeb9b7b6ead tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:07.502025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3e882c67-da1f-4e99-a34f-ddeb9b7b6ead tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:07.556741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3e882c67-da1f-4e99-a34f-ddeb9b7b6ead tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:07.564163 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3e882c67-da1f-4e99-a34f-ddeb9b7b6ead tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1214 microversion: 2.1 time: 0.066575 Sep 16 03:58:07.564726 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 535/1071] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:07 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:58:08.402248 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:08.402883 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:08.410073 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:08.410553 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:08.411021 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:08.411704 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:08.412152 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:08.412569 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:08.554144 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:08.559910 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5d69660b-d794-407e-ad94-7af280575a04 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1314 microversion: 2.1 time: 0.162227 Sep 16 03:58:08.560898 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 537/1072] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:08 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:08.590393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:08.591379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:08.598722 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:08.599313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:08.599814 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:08.600506 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:08.600976 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:08.601529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:08.663585 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:08.671470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c658bd18-ec6b-4f2a-a42c-78e56faf5fb8 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1218 microversion: 2.1 time: 0.085614 Sep 16 03:58:08.672035 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 536/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:08 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:09.583603 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:09.584391 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:09.591359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:09.591927 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:09.592434 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:09.593205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:09.593723 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:09.594154 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:09.693526 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:09.694661 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:09.701516 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:09.702323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:09.702760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:09.703503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:09.704164 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:09.704753 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:09.772054 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:09.781441 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0d61289a-9075-49de-ac1f-64eda39a5a83 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1274 microversion: 2.1 time: 0.091707 Sep 16 03:58:09.782012 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 537/1074] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:09 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:58:09.852480 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:09.862373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e7b724d6-9e3a-437a-ae59-a9aaca2e9799 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1314 microversion: 2.1 time: 0.282591 Sep 16 03:58:09.863323 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 538/1075] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:09 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:10.805547 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:10.806375 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:10.813822 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:10.816199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:10.816199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:10.816199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:10.816199 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:10.816684 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:10.887060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:10.887674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:10.893910 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:10.894615 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:10.895145 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:10.895846 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:10.896301 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:10.896728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:10.957772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:10.966792 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-26e5c823-d1d2-482f-85cc-75ae8112b472 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.165241 Sep 16 03:58:10.967428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 538/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:10 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:11.107627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:11.115568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fd3be239-1185-4bba-8506-e225ca51abda tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1314 microversion: 2.1 time: 0.233709 Sep 16 03:58:11.116134 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 539/1077] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:10 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:58:11.402647 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-c456f0da-fd80-4294-854a-cbbad357a596 req-8ee453fc-d28e-4c36-abb3-6c3d65366619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e804c550-5dd6-415e-896f-7fb5fdcf0124", "tag": "e0c08b5f-21c3-48ec-b031-69af9776341a"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:11.410577 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0f2fbe16-ecde-400a-a71f-f965767389a0 req-0670c74e-b18b-4a9d-9283-80cdeee9cc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a4d2c5-b48d-4967-9a36-474f8806d840", "name": "network-vif-plugged", "status": "completed", "tag": "4f696dc9-c720-4565-95c8-fbe193a6732a"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:11.424950 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c456f0da-fd80-4294-854a-cbbad357a596 req-8ee453fc-d28e-4c36-abb3-6c3d65366619 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:11.425510 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c456f0da-fd80-4294-854a-cbbad357a596 req-8ee453fc-d28e-4c36-abb3-6c3d65366619 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:11.425932 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c456f0da-fd80-4294-854a-cbbad357a596 req-8ee453fc-d28e-4c36-abb3-6c3d65366619 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:11.426462 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0f2fbe16-ecde-400a-a71f-f965767389a0 req-0670c74e-b18b-4a9d-9283-80cdeee9cc5a service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:11.426972 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0f2fbe16-ecde-400a-a71f-f965767389a0 req-0670c74e-b18b-4a9d-9283-80cdeee9cc5a service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:11.427590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0f2fbe16-ecde-400a-a71f-f965767389a0 req-0670c74e-b18b-4a9d-9283-80cdeee9cc5a service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:11.438324 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-c456f0da-fd80-4294-854a-cbbad357a596 req-8ee453fc-d28e-4c36-abb3-6c3d65366619 service nova] Creating event network-changed:e0c08b5f-21c3-48ec-b031-69af9776341a for instance e804c550-5dd6-415e-896f-7fb5fdcf0124 on hv-cinder-85799 Sep 16 03:58:11.440464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0f2fbe16-ecde-400a-a71f-f965767389a0 req-0670c74e-b18b-4a9d-9283-80cdeee9cc5a service nova] Creating event network-vif-plugged:4f696dc9-c720-4565-95c8-fbe193a6732a for instance 93a4d2c5-b48d-4967-9a36-474f8806d840 on hv-cinder-85799 Sep 16 03:58:11.443515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-c456f0da-fd80-4294-854a-cbbad357a596 req-8ee453fc-d28e-4c36-abb3-6c3d65366619 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047326 Sep 16 03:58:11.444642 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 539/1078] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:58:11.447555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0f2fbe16-ecde-400a-a71f-f965767389a0 req-0670c74e-b18b-4a9d-9283-80cdeee9cc5a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038766 Sep 16 03:58:11.447555 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 540/1079] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 03:58:11.990823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:11.991477 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:11.998237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:11.998718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:11.999184 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:11.999877 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:12.000329 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:12.000754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:12.020029 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:12.139390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:12.140826 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:12.147938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:12.148423 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:12.149077 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:12.149779 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:12.150260 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:12.150680 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:12.155599 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:12.309649 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:12.317601 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e85d2120-d0fb-4598-a214-23bca84075fb tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.331518 Sep 16 03:58:12.318150 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 540/1080] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:11 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:12.394701 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:12.402496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b8084a85-8037-4a0a-a52e-18852d9ee2fe tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1314 microversion: 2.1 time: 0.268215 Sep 16 03:58:12.403088 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 541/1081] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:12 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:58:13.340183 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:13.340799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:13.347083 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:13.347561 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:13.347992 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:13.348772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:13.349225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:13.349641 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:13.425774 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:13.426494 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:13.433709 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:13.434194 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:13.434616 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:13.435331 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:13.436568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:13.436982 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:13.487982 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:13.496741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c97f8c38-eccc-4994-a24e-d41e95559a7f tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.159964 Sep 16 03:58:13.497459 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 541/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:13 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:58:13.624865 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:13.632532 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-95141f44-3a8c-4eeb-b2eb-78d76fa32b5b tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1463 microversion: 2.1 time: 0.210721 Sep 16 03:58:13.633106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 542/1083] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:13 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1463 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:58:13.679275 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:13.679803 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:13.686028 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:13.686503 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:13.686947 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:13.687634 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:13.688079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:13.688494 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:13.712938 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:58:14.128086 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cf6cfd1a-20b3-4491-8623-7f951c478764 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 204 len: 0 microversion: 2.1 time: 0.452477 Sep 16 03:58:14.128713 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 542/1084] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:58:13 2022] DELETE /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:58:14.138008 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:14.138627 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:14.153588 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:14.154090 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:14.154529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:14.155274 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:14.155728 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:14.156155 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:14.288409 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:14.296017 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9de25ede-29eb-4137-a2ad-40157b3618e4 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1469 microversion: 2.1 time: 0.162732 Sep 16 03:58:14.296570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 543/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:14 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:14.519267 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:14.519958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:14.526269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:14.526745 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:14.527208 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:14.527887 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:14.528325 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:14.528740 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:14.664490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:14.672790 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-576c7fa1-2fb8-4078-b20f-fa1997a0a92a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.157819 Sep 16 03:58:14.673361 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 543/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:14 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:15.320207 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:15.320837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:15.327521 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:15.328041 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:15.328482 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:15.329562 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:15.329668 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:15.330031 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:15.470658 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:15.478398 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f800b947-2e88-485f-8ac1-ae92563b1e0c tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1469 microversion: 2.1 time: 0.162059 Sep 16 03:58:15.478984 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 544/1087] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:15 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:15.696252 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:15.696905 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:15.704192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:15.704681 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:15.705120 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:15.705824 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:15.706297 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:15.706744 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:15.838518 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:15.846072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-daca5df9-4853-4bf4-8ab0-9aaee9f13c6b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.153789 Sep 16 03:58:15.846634 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 544/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:15 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 03:58:16.113590 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-34d6bce5-ea89-4f9d-a599-d0d671ba7f0f req-fe107edf-70f9-4a7d-b234-4014db0c5a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a4d2c5-b48d-4967-9a36-474f8806d840", "name": "network-vif-deleted", "tag": "4f696dc9-c720-4565-95c8-fbe193a6732a"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:16.127803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-34d6bce5-ea89-4f9d-a599-d0d671ba7f0f req-fe107edf-70f9-4a7d-b234-4014db0c5a8f service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:16.127803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-34d6bce5-ea89-4f9d-a599-d0d671ba7f0f req-fe107edf-70f9-4a7d-b234-4014db0c5a8f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:16.127803 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-34d6bce5-ea89-4f9d-a599-d0d671ba7f0f req-fe107edf-70f9-4a7d-b234-4014db0c5a8f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:16.137718 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-34d6bce5-ea89-4f9d-a599-d0d671ba7f0f req-fe107edf-70f9-4a7d-b234-4014db0c5a8f service nova] Creating event network-vif-deleted:4f696dc9-c720-4565-95c8-fbe193a6732a for instance 93a4d2c5-b48d-4967-9a36-474f8806d840 on hv-cinder-85799 Sep 16 03:58:16.143741 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-34d6bce5-ea89-4f9d-a599-d0d671ba7f0f req-fe107edf-70f9-4a7d-b234-4014db0c5a8f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034983 Sep 16 03:58:16.144348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 545/1089] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:58:16.501819 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:16.502454 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:16.508446 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:16.508932 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:16.509363 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:16.510056 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:16.510486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:16.510921 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:16.545055 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:16.545545 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:16.546614 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:16.547116 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lazy-loading 'fault' on Instance uuid 93a4d2c5-b48d-4967-9a36-474f8806d840 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 03:58:16.589783 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28d6bcc3a664d498d07890e2cab7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a2763e5c146c783f15114b4070a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:16.598056 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f0b27046-63c7-47de-9ebd-88649fbbc641 tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 200 len: 1304 microversion: 2.1 time: 0.100315 Sep 16 03:58:16.598607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 545/1090] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:16 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:16.870367 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:16.871116 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:16.877203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:16.877791 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:16.878106 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:16.878818 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:16.879295 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:16.879717 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:17.008511 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:17.016946 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0397918d-8747-40ae-af36-1c44f158fe0c tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.151211 Sep 16 03:58:17.017517 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 546/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:16 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:17.629584 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:17.630379 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] [instance: 93a4d2c5-b48d-4967-9a36-474f8806d840] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:17.632906 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:17.637622 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:17.638095 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:17.638548 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:17.639298 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:17.644360 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:17.644360 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:17.653737 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] HTTP exception thrown: Instance 93a4d2c5-b48d-4967-9a36-474f8806d840 could not be found. Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Request method failure captured: Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 HTTP/1.1 Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_REFcXWfdIfOHVhUxkDQx4FoEsZNt8JlBgM3FeJRssLiDmFuaStjZkpliX6dhsYBy6e8wYxeuj6fACBpKAlp9EKIm72snfQTjnbRq5qNpYO13D7gkKCk9pfNFUsN7mmdALLCHslklKKrg39K3ixAksM2e2a7R1ZpfZMp3YWL7CuUHc Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 548a2763e5c146c783f15114b4070a0d Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-2118766215 Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 03:58:17.655402 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/548a2763e5c146c783f15114b4070a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_548a2763e5c146c783f15114b4070a0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/548a2763e5c146c783f15114b4070a0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/548a2763e5c146c783f15114b4070a0d"}]}] Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-2118766215 Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 548a2763e5c146c783f15114b4070a0d Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-2118766215 Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-2118766215-project Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: a28d6bcc3a664d498d07890e2cab7f1a Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-2118766215-project Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 93a4d2c5-b48d-4967-9a36-474f8806d840 could not be found. Sep 16 03:58:17.657126 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '93a4d2c5-b48d-4967-9a36-474f8806d840'} Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a4d2c5-b48d-4967-9a36-474f8806d840 could not be found. Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:58:17.658053 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a4d2c5-b48d-4967-9a36-474f8806d840 could not be found. Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a4d2c5-b48d-4967-9a36-474f8806d840 could not be found. Sep 16 03:58:17.659404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 03:58:17.660691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] Returning 404 to user: Instance 93a4d2c5-b48d-4967-9a36-474f8806d840 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:58:17.660691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-edb9577a-a161-44b3-974e-649ac57463bc tempest-VolumesNegativeTest-2118766215 tempest-VolumesNegativeTest-2118766215-project] 10.222.0.49 "GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840" status: 404 len: 111 microversion: 2.1 time: 0.033512 Sep 16 03:58:17.660691 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 546/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:17 2022] GET /compute/v2.1/servers/93a4d2c5-b48d-4967-9a36-474f8806d840 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 03:58:18.039951 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:18.040566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:18.042481 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:18.043182 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=14 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:18.049471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:18.049964 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:18.050380 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:18.051135 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:18.051626 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:18.052049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:18.196944 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:18.204929 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-31f48fd8-a64e-496d-bdb9-a9259b2d2b9a tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.168886 Sep 16 03:58:18.205496 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 547/1093] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:18 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:19.228228 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:19.228829 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:19.239127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:19.239127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:19.239127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:19.239127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:19.240057 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:19.240810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:19.241235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:19.384961 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:19.393235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fef168b9-cf9c-4b81-a2c9-01568e49ace6 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.168797 Sep 16 03:58:19.393811 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 547/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:19 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:19.431432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-52ab6353-b51c-4ef3-b136-2f85555a32a1 req-f937279c-0bb2-43d8-9109-b79776fa807e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e804c550-5dd6-415e-896f-7fb5fdcf0124", "name": "network-vif-plugged", "status": "completed", "tag": "e0c08b5f-21c3-48ec-b031-69af9776341a"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:19.441335 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-52ab6353-b51c-4ef3-b136-2f85555a32a1 req-f937279c-0bb2-43d8-9109-b79776fa807e service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:19.441809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-52ab6353-b51c-4ef3-b136-2f85555a32a1 req-f937279c-0bb2-43d8-9109-b79776fa807e service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:19.442231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-52ab6353-b51c-4ef3-b136-2f85555a32a1 req-f937279c-0bb2-43d8-9109-b79776fa807e service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:19.452925 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-52ab6353-b51c-4ef3-b136-2f85555a32a1 req-f937279c-0bb2-43d8-9109-b79776fa807e service nova] Creating event network-vif-plugged:e0c08b5f-21c3-48ec-b031-69af9776341a for instance e804c550-5dd6-415e-896f-7fb5fdcf0124 on hv-cinder-85799 Sep 16 03:58:19.457702 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-52ab6353-b51c-4ef3-b136-2f85555a32a1 req-f937279c-0bb2-43d8-9109-b79776fa807e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030021 Sep 16 03:58:19.458271 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 548/1095] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:58:20.416940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:20.417547 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:20.424983 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:20.425456 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:20.425882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:20.426563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:20.427041 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:20.427462 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:20.555936 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:20.567574 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b1237c1b-2890-47e4-b869-55173ecafa0e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1314 microversion: 2.1 time: 0.154385 Sep 16 03:58:20.568151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 548/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:20 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:21.591203 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:21.592480 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:21.594817 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:21.600146 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:21.600625 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:21.601604 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:21.601604 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:21.602154 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:21.602570 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:21.745396 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:21.753330 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-42bcfcf2-ff21-46ba-a80c-e6f1aeb182ff tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1499 microversion: 2.1 time: 0.167063 Sep 16 03:58:21.753893 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 549/1097] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:21 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1499 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:22.596399 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:22.596940 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:22.603490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:22.603968 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:22.604396 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:22.605079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:22.605571 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:22.606039 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:22.630620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 03:58:22.893858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2e32897b-3cb0-420b-99a4-e13f6eb68dcc tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 204 len: 0 microversion: 2.1 time: 0.300978 Sep 16 03:58:22.894360 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 549/1098] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 03:58:22 2022] DELETE /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 03:58:22.902697 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:22.903334 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:22.910522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:22.911040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:22.916742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:22.916742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:22.916742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:22.916742 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:23.039639 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:23.048139 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-88d5205a-f5b4-4b29-8a77-d7dabc83317e tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1505 microversion: 2.1 time: 0.149360 Sep 16 03:58:23.048697 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 550/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:22 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:24.072674 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:24.073371 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:24.080706 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:24.081184 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:24.081610 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:24.082302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:24.082754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:24.083196 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:24.244762 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:24.253280 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a69eec59-84a1-4162-b95d-625b4a088ff0 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1505 microversion: 2.1 time: 0.184794 Sep 16 03:58:24.253860 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 550/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:24 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:25.064641 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0dbed75f-ff13-48a3-aaad-73e6c44e0465 req-2910fd38-b8aa-4531-87b9-147c1e7ed50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e804c550-5dd6-415e-896f-7fb5fdcf0124", "name": "network-vif-deleted", "tag": "e0c08b5f-21c3-48ec-b031-69af9776341a"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:25.073903 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0dbed75f-ff13-48a3-aaad-73e6c44e0465 req-2910fd38-b8aa-4531-87b9-147c1e7ed50d service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:25.074384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0dbed75f-ff13-48a3-aaad-73e6c44e0465 req-2910fd38-b8aa-4531-87b9-147c1e7ed50d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:25.074819 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0dbed75f-ff13-48a3-aaad-73e6c44e0465 req-2910fd38-b8aa-4531-87b9-147c1e7ed50d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:25.085938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0dbed75f-ff13-48a3-aaad-73e6c44e0465 req-2910fd38-b8aa-4531-87b9-147c1e7ed50d service nova] Creating event network-vif-deleted:e0c08b5f-21c3-48ec-b031-69af9776341a for instance e804c550-5dd6-415e-896f-7fb5fdcf0124 on hv-cinder-85799 Sep 16 03:58:25.090988 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0dbed75f-ff13-48a3-aaad-73e6c44e0465 req-2910fd38-b8aa-4531-87b9-147c1e7ed50d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031909 Sep 16 03:58:25.091522 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 551/1101] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:58:25.277744 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:25.278396 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:25.286110 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:25.287114 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:25.300515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:25.300515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:25.300515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:25.300515 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:25.370858 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6794c30b34984af2b3eb6c0902a6157d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada320ab9e1644f29fd613c173ffe0a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:58:25.379764 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dd833093-c406-4237-ae63-65ff4a359f3b tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 200 len: 1299 microversion: 2.1 time: 0.106019 Sep 16 03:58:25.380334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 551/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:25 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:58:26.402967 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:58:26.403575 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] [instance: e804c550-5dd6-415e-896f-7fb5fdcf0124] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:58:26.410197 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:26.410766 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:26.411329 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:26.412108 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:58:26.412660 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:58:26.415485 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:58:26.429329 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] HTTP exception thrown: Instance e804c550-5dd6-415e-896f-7fb5fdcf0124 could not be found. Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Request method failure captured: Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 HTTP/1.1 Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_Q6AkTRxjKODJ_KwU95z129ie2ol8y_NKPPaF5TyDFlRQN9n8maLJf58B04DpPh7LkXVJ5yKtwbgG6ovKohQ8cDFOXT44--RXVGlxrR_AEhMRY0BUJZjCKKsgPAk9_Pfdte_WJkA3x6LLIOVEDLDUxgTbNxvaCJK4qrxLkcnVEZTmI Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: ada320ab9e1644f29fd613c173ffe0a8 Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesActionsTest-185621777 Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 03:58:26.431007 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ada320ab9e1644f29fd613c173ffe0a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ada320ab9e1644f29fd613c173ffe0a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ada320ab9e1644f29fd613c173ffe0a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ada320ab9e1644f29fd613c173ffe0a8"}]}] Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesActionsTest-185621777 Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: ada320ab9e1644f29fd613c173ffe0a8 Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesActionsTest-185621777 Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesActionsTest-185621777-project Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: 6794c30b34984af2b3eb6c0902a6157d Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesActionsTest-185621777-project Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance e804c550-5dd6-415e-896f-7fb5fdcf0124 could not be found. Sep 16 03:58:26.432757 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'e804c550-5dd6-415e-896f-7fb5fdcf0124'} Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e804c550-5dd6-415e-896f-7fb5fdcf0124 could not be found. Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 03:58:26.433672 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e804c550-5dd6-415e-896f-7fb5fdcf0124 could not be found. Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e804c550-5dd6-415e-896f-7fb5fdcf0124 could not be found. Sep 16 03:58:26.435231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 03:58:26.437436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] Returning 404 to user: Instance e804c550-5dd6-415e-896f-7fb5fdcf0124 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 03:58:26.437436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-022fc3a5-e3f6-46f9-ad0a-5d54d55586c5 tempest-VolumesActionsTest-185621777 tempest-VolumesActionsTest-185621777-project] 10.222.0.49 "GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124" status: 404 len: 111 microversion: 2.1 time: 0.034544 Sep 16 03:58:26.437436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 552/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:58:26 2022] GET /compute/v2.1/servers/e804c550-5dd6-415e-896f-7fb5fdcf0124 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 03:58:39.734594 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:39.736687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:40.053464 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2cb54e94-3428-4f19-b3b4-b0bb7a248643 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Action: 'create', calling method: .version_select at 0x7fba7c676670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-106478167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvOje8inYZMpgRI09FuGiDzFUGfhqXD9tU+7LCnNNRXTcw9KvrA8nk89wv/9VFFBhRdI8jhTQcSJmW9i6UUZUloRxgen+hj+0bDYYvMIUuZT+52FKvaL6LtzwPtmOMpeA=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:58:40.071454 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-2cb54e94-3428-4f19-b3b4-b0bb7a248643 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Getting quotas for project 42406ac5a18945dea55e37a91e9f5530. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:58:40.076933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-2cb54e94-3428-4f19-b3b4-b0bb7a248643 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Getting quotas for user d8b2c15cd31544069f0888a04bfe0c63 and project 42406ac5a18945dea55e37a91e9f5530. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:58:40.154558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2cb54e94-3428-4f19-b3b4-b0bb7a248643 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.424958 Sep 16 03:58:40.156510 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 552/1104] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 16 03:58:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:59:05.394560 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1781108996", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-106478167", "security_groups": [{"name": "tempest-secgroup-smoke-1031301844"}], "block_device_mapping_v2": [{"uuid": "3b630460-77da-4ee6-9c9d-c18a8490d293", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6fd8153b-b435-473d-99b3-693648eee8c9"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:59:05.405393 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=7 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:05.406049 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=54 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:05.512716 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] validate_networks() for [('6fd8153b-b435-473d-99b3-693648eee8c9', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 03:59:05.986137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 03:59:05.986560 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 03:59:05.987110 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 03:59:05.987567 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 03:59:05.988044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 03:59:05.996865 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:05.997351 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:05.997787 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:05.998513 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:05.999001 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:05.999471 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:06.016608 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Getting quotas for project 42406ac5a18945dea55e37a91e9f5530. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 03:59:06.021060 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Getting quotas for user d8b2c15cd31544069f0888a04bfe0c63 and project 42406ac5a18945dea55e37a91e9f5530. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 03:59:06.078455 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 03:59:06.081797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b630460-77da-4ee6-9c9d-c18a8490d293',volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 03:59:06.444634 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-07050a59-055e-45b3-b3b8-326e05333cc9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.054451 Sep 16 03:59:06.445561 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 553/1105] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 03:59:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 03:59:06.453922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:06.454668 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:06.458756 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3a5a041a-95aa-4dff-b8d0-7693d14688f8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:06.460914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3a5a041a-95aa-4dff-b8d0-7693d14688f8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:06.515854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a5a041a-95aa-4dff-b8d0-7693d14688f8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:06.523320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3a5a041a-95aa-4dff-b8d0-7693d14688f8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1094 microversion: 2.1 time: 0.070742 Sep 16 03:59:06.523894 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 553/1106] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:06 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:07.546267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7afdc3d2-9a9a-4e19-85e5-1cb49e0bf8f7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:07.546866 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7afdc3d2-9a9a-4e19-85e5-1cb49e0bf8f7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:07.598933 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7afdc3d2-9a9a-4e19-85e5-1cb49e0bf8f7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:07.606109 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7afdc3d2-9a9a-4e19-85e5-1cb49e0bf8f7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1094 microversion: 2.1 time: 0.064227 Sep 16 03:59:07.606689 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 554/1107] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:07 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:08.629416 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:08.630063 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:08.637162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:08.637640 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:08.638077 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:08.638899 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:08.639373 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:08.639799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:08.701189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:08.712281 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6e8035fe-dd10-439b-a721-331a6262356a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1192 microversion: 2.1 time: 0.085859 Sep 16 03:59:08.712849 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 554/1108] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:08 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:09.745097 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:09.745715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:09.753044 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:09.753528 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:09.754009 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:09.754664 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:09.755140 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:09.755564 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:09.831428 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:09.839345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9bd293be-78da-458b-bbb4-76ca9126a61b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1210 microversion: 2.1 time: 0.098096 Sep 16 03:59:09.839901 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 555/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:09 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:10.865313 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:10.867449 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:10.873963 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:10.876382 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:10.876828 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:10.877538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:10.877992 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:10.879311 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:11.018381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:11.027120 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ebf41032-ed75-4b2c-8bf2-d7bda401e80f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1278 microversion: 2.1 time: 0.167269 Sep 16 03:59:11.027785 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 555/1110] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:10 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:11.374491 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0d4df3df-e9a4-4454-9334-404c10c74b32 req-24abbf16-d47d-418e-bcaa-c08d6e0af683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c29179-15b1-4f96-89b5-3cede4ba5a26", "tag": "05df5516-acf5-42ed-b912-186414093bf4"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:59:11.384384 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0d4df3df-e9a4-4454-9334-404c10c74b32 req-24abbf16-d47d-418e-bcaa-c08d6e0af683 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:11.384862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0d4df3df-e9a4-4454-9334-404c10c74b32 req-24abbf16-d47d-418e-bcaa-c08d6e0af683 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:11.385292 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0d4df3df-e9a4-4454-9334-404c10c74b32 req-24abbf16-d47d-418e-bcaa-c08d6e0af683 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:11.396695 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0d4df3df-e9a4-4454-9334-404c10c74b32 req-24abbf16-d47d-418e-bcaa-c08d6e0af683 service nova] Creating event network-changed:05df5516-acf5-42ed-b912-186414093bf4 for instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 on hv-cinder-85799 Sep 16 03:59:11.401664 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0d4df3df-e9a4-4454-9334-404c10c74b32 req-24abbf16-d47d-418e-bcaa-c08d6e0af683 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152904 Sep 16 03:59:11.402246 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 556/1111] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:59:12.052151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:12.052765 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:12.059170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:12.059650 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:12.060089 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:12.060775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:12.061225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:12.061903 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:12.198566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:12.209283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e73e6709-f68a-4c7e-968f-88224064b94c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.159161 Sep 16 03:59:12.209283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 556/1112] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:12 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:13.232525 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:13.233213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:13.239891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:13.240364 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:13.240792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:13.241464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:13.241907 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:13.242327 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:13.373072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:13.380688 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ff37746e-b69b-4300-a135-2f06136dbde4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.152807 Sep 16 03:59:13.381240 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 557/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:13 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:14.403537 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:14.404156 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:14.411215 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:14.411698 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:14.412131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:14.412824 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:14.413274 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:14.413695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:14.542428 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:14.550094 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-50c28860-e3fc-430e-b51c-1311684ad4df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.150468 Sep 16 03:59:14.550708 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 557/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:14 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:15.573267 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:15.573936 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:15.580397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:15.580813 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:15.581237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:15.582224 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:15.582680 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:15.583195 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:15.714740 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:15.722298 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b28cb688-2f66-4997-af7b-7f979eb03741 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.152924 Sep 16 03:59:15.723391 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 558/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:15 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:16.745266 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:16.745882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:16.748289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:16.753079 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:16.753565 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:16.754562 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:16.755294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:16.755748 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:16.756175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:16.888020 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:16.896288 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c77812f6-ddc2-4e67-8dfa-fa69a70b3b49 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.154915 Sep 16 03:59:16.896853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 558/1116] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:16 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:17.919317 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:17.919938 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:17.921848 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:17.923076 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=8 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:17.928643 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:17.929128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:17.929568 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:17.930253 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:17.930705 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:17.931189 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:18.067990 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:18.075499 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0ed08e2a-9baf-4721-a6d1-4c75e2259155 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.160100 Sep 16 03:59:18.076053 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 559/1117] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:17 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:19.097840 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:19.098594 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:19.105018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:19.105490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:19.105920 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:19.106598 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:19.107068 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:19.107485 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:19.236850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:19.245127 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d0058a1c-b32f-48ef-ae99-a9edad21234a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.151133 Sep 16 03:59:19.245678 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 559/1118] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:19 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:20.268148 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:20.268765 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:20.275348 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:20.275840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:20.276275 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:20.276967 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:20.277421 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:20.277842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:20.410708 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:20.419054 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2c81601c-6bf8-4f15-8358-975d43e32092 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.154761 Sep 16 03:59:20.419612 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 560/1119] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:20 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:21.441882 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:21.443168 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:21.449645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:21.450130 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:21.450568 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:21.451291 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:21.451753 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:21.452178 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:21.588755 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:21.596480 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-723cb9d8-d75c-4473-b704-47b7ab27f2df tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.158516 Sep 16 03:59:21.597052 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 560/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:21 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:21.745304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-41ec540f-768a-4c2e-82ff-4f1647cacc7e req-0dc23b4d-d650-43cb-a695-e7a9c8506b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c29179-15b1-4f96-89b5-3cede4ba5a26", "name": "network-vif-plugged", "status": "completed", "tag": "05df5516-acf5-42ed-b912-186414093bf4"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:59:21.755318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-41ec540f-768a-4c2e-82ff-4f1647cacc7e req-0dc23b4d-d650-43cb-a695-e7a9c8506b31 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:21.755797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-41ec540f-768a-4c2e-82ff-4f1647cacc7e req-0dc23b4d-d650-43cb-a695-e7a9c8506b31 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:21.756229 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-41ec540f-768a-4c2e-82ff-4f1647cacc7e req-0dc23b4d-d650-43cb-a695-e7a9c8506b31 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:21.766946 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-41ec540f-768a-4c2e-82ff-4f1647cacc7e req-0dc23b4d-d650-43cb-a695-e7a9c8506b31 service nova] Creating event network-vif-plugged:05df5516-acf5-42ed-b912-186414093bf4 for instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 on hv-cinder-85799 Sep 16 03:59:21.772137 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-41ec540f-768a-4c2e-82ff-4f1647cacc7e req-0dc23b4d-d650-43cb-a695-e7a9c8506b31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030702 Sep 16 03:59:21.772718 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 561/1121] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 03:59:22.620235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:22.620872 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:22.627244 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:22.627718 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:22.628144 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:22.628816 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:22.629260 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:22.630302 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:22.757929 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:22.766090 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2472904b-8aec-460a-8a5b-2e0ed833b317 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.149719 Sep 16 03:59:22.766649 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 561/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:22 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:23.790297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:23.791128 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:23.798931 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:23.799573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:23.800042 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:23.800908 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:23.801556 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:23.802300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:23.942899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:23.950713 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f11f6e2-1b86-4f19-9b0c-4a16fc93438c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1266 microversion: 2.1 time: 0.165359 Sep 16 03:59:23.951296 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 562/1123] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:23 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:24.974193 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:24.974799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:24.981200 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:24.981669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:24.982098 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:24.982772 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:24.983246 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:24.983669 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:25.113670 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:25.122269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0bd23f0a-003d-472a-80af-215a46aa7acb tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1454 microversion: 2.1 time: 0.151928 Sep 16 03:59:25.122775 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 562/1124] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:24 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:25.149316 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 03:59:25.149934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 03:59:25.155797 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:25.156281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:25.156748 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:25.157433 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:25.157885 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:25.158309 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:25.289310 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 03:59:25.297034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a0f5049b-19ef-4fda-aab6-8b0464c172c7 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1454 microversion: 2.1 time: 0.152005 Sep 16 03:59:25.297597 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 563/1125] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 03:59:25 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 03:59:27.619749 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-413e65a2-b7ac-4a56-92d1-e01ba8142c74 req-bdbb41b1-c49e-45fb-b8c1-2a2a7ec1fdce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c29179-15b1-4f96-89b5-3cede4ba5a26", "tag": "05df5516-acf5-42ed-b912-186414093bf4"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 03:59:27.629566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-413e65a2-b7ac-4a56-92d1-e01ba8142c74 req-bdbb41b1-c49e-45fb-b8c1-2a2a7ec1fdce service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 03:59:27.630032 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-413e65a2-b7ac-4a56-92d1-e01ba8142c74 req-bdbb41b1-c49e-45fb-b8c1-2a2a7ec1fdce service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 03:59:27.630454 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-413e65a2-b7ac-4a56-92d1-e01ba8142c74 req-bdbb41b1-c49e-45fb-b8c1-2a2a7ec1fdce service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 03:59:27.641567 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-413e65a2-b7ac-4a56-92d1-e01ba8142c74 req-bdbb41b1-c49e-45fb-b8c1-2a2a7ec1fdce service nova] Creating event network-changed:05df5516-acf5-42ed-b912-186414093bf4 for instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 on hv-cinder-85799 Sep 16 03:59:27.646721 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-413e65a2-b7ac-4a56-92d1-e01ba8142c74 req-bdbb41b1-c49e-45fb-b8c1-2a2a7ec1fdce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030634 Sep 16 03:59:27.647338 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 563/1126] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 03:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:01:23.232168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 04:01:23.232684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Fri Sep 16 04:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 (ip 10.222.0.49) !!! Sep 16 04:01:23.233802 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:01:23.234547 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=48 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:01:23.238611 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:23.244602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:23.246167 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:23.247230 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:23.247674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:23.248350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:23.248796 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:23.249213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:23.275684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 04:01:23.551594 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-68637b5a-3e76-4b75-bc68-9a14e5d4a069 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "DELETE /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 204 len: 0 microversion: 2.1 time: 0.321522 Sep 16 04:01:23.552181 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 564/1127] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 04:01:23 2022] DELETE /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 04:01:23.558662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 04:01:23.559853 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Fri Sep 16 04:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 (ip 10.222.0.49) !!! Sep 16 04:01:23.560914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dfa5486-d001-40a1-a06f-cbfc5ed18611] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 04:01:23.561497 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=24 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:01:23.562226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=56 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:01:23.567702 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:23.568403 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:23.575854 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:23.577131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:23.577131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:23.577414 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:23.577859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:23.578277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:23.712045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:23.720058 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d5e9be6c-181e-45f1-8de3-d0b6e2fe0177 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1578 microversion: 2.1 time: 0.163460 Sep 16 04:01:23.720622 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 564/1128] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:23 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:24.744380 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:24.745070 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:24.752327 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:24.752813 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:24.753277 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:24.753981 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:24.754427 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:24.754843 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:24.887818 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:24.895469 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8bcc6f11-3f84-4084-8a57-357e4c74a48b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1578 microversion: 2.1 time: 0.155335 Sep 16 04:01:24.895972 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 565/1129] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:24 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:25.919282 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:25.919874 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:25.927538 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:25.928018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:25.928449 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:25.929142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:25.929590 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:25.930011 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:25.946264 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dfa5486-d001-40a1-a06f-cbfc5ed18611] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 55646. Sep 16 04:01:26.064760 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:26.072701 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1f376b23-9b09-4663-8f24-5491d1d3910b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1578 microversion: 2.1 time: 0.157531 Sep 16 04:01:26.073265 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 565/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:25 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:26.371392 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-1cf28f2d-ce30-4404-b110-9bdee91e2570 req-fa98b95b-68ef-4819-88fc-da758363b608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c29179-15b1-4f96-89b5-3cede4ba5a26", "name": "network-vif-deleted", "tag": "05df5516-acf5-42ed-b912-186414093bf4"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:01:26.382199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-1cf28f2d-ce30-4404-b110-9bdee91e2570 req-fa98b95b-68ef-4819-88fc-da758363b608 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:26.382674 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-1cf28f2d-ce30-4404-b110-9bdee91e2570 req-fa98b95b-68ef-4819-88fc-da758363b608 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:26.383132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-1cf28f2d-ce30-4404-b110-9bdee91e2570 req-fa98b95b-68ef-4819-88fc-da758363b608 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:26.394520 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-1cf28f2d-ce30-4404-b110-9bdee91e2570 req-fa98b95b-68ef-4819-88fc-da758363b608 service nova] Creating event network-vif-deleted:05df5516-acf5-42ed-b912-186414093bf4 for instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 on hv-cinder-85799 Sep 16 04:01:26.399474 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-1cf28f2d-ce30-4404-b110-9bdee91e2570 req-fa98b95b-68ef-4819-88fc-da758363b608 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031761 Sep 16 04:01:26.400536 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 566/1131] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:01:27.097369 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:27.098155 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:27.105941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:27.107690 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:27.108789 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:27.109711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:27.110349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:27.110977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:27.189253 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:27.194975 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-35cecc9c-ee00-48e9-bebf-0459879edf37 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1225 microversion: 2.1 time: 0.101376 Sep 16 04:01:27.195998 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 566/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:27 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:28.219619 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:28.220328 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:28.226397 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:28.226871 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:28.227339 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:28.228169 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:28.228464 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:28.228883 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:28.260646 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:28.261125 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:28.261559 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:28.262011 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lazy-loading 'fault' on Instance uuid 08c29179-15b1-4f96-89b5-3cede4ba5a26 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 04:01:28.306718 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:28.315857 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5350f713-ddf0-448e-89c3-b5e69b60f72e tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 200 len: 1230 microversion: 2.1 time: 0.101310 Sep 16 04:01:28.316429 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 567/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:28 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:29.341935 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:29.342560 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:29.349677 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:29.350162 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:29.350596 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:29.351319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:29.351773 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:29.352198 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:29.366440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] HTTP exception thrown: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Request method failure captured: Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 HTTP/1.1 Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_RnaFGj5sxjdCRB0-CGl_ea4BmCjcBEvRsvLsORyxPLB-LseH3r38yfCZU4ILNw2nggAwrRsIiMT5gn4psFbhd0r6HWqKoJnH2-2guaTvKAuEXp3stva-O4WIodpOLWTR6XUixrRR7Y__rSnOqS7FyuxxlzLIEe35619Elj76TwH4c Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 04:01:29.368122 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}] Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: d8b2c15cd31544069f0888a04bfe0c63 Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:01:29.369914 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '08c29179-15b1-4f96-89b5-3cede4ba5a26'} Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 04:01:29.370859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:01:29.372445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:01:29.373823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Returning 404 to user: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 04:01:29.373823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3d9b61b3-c1cf-4bf5-bf86-7868012a46d2 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 404 len: 111 microversion: 2.1 time: 0.031453 Sep 16 04:01:29.373823 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 567/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:29 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 04:01:29.422548 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1205958481", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-106478167", "security_groups": [{"name": "tempest-secgroup-smoke-1031301844"}], "block_device_mapping_v2": [{"uuid": "3b630460-77da-4ee6-9c9d-c18a8490d293", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6fd8153b-b435-473d-99b3-693648eee8c9"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:01:29.536459 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] validate_networks() for [('6fd8153b-b435-473d-99b3-693648eee8c9', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 04:01:29.900213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 04:01:29.900637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 04:01:29.901107 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 04:01:29.901512 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 04:01:29.901920 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 04:01:29.910842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:29.911351 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:29.911776 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:29.912487 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:29.912932 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:29.913346 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:29.929855 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Getting quotas for project 42406ac5a18945dea55e37a91e9f5530. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 04:01:29.933838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Getting quotas for user d8b2c15cd31544069f0888a04bfe0c63 and project 42406ac5a18945dea55e37a91e9f5530. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 04:01:29.991724 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 04:01:29.993899 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b630460-77da-4ee6-9c9d-c18a8490d293',volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 04:01:30.371734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e01d1c63-a8fe-4bf0-a9fe-06be3992e740 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.953568 Sep 16 04:01:30.372387 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 568/1135] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 04:01:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 04:01:30.384382 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8fabf9c6-254c-469d-8fc8-4788e8fda19d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:30.385022 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8fabf9c6-254c-469d-8fc8-4788e8fda19d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:30.439250 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8fabf9c6-254c-469d-8fc8-4788e8fda19d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:30.446837 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8fabf9c6-254c-469d-8fc8-4788e8fda19d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1094 microversion: 2.1 time: 0.066623 Sep 16 04:01:30.447410 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 568/1136] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:30 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:31.469794 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:31.470512 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:31.477199 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:31.477687 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:31.478120 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:31.478838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:31.479324 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:31.479745 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:31.542463 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:31.551112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d33cff56-4565-4e12-a8ad-2db70916569a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1144 microversion: 2.1 time: 0.085823 Sep 16 04:01:31.551934 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 569/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:31 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:32.575558 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:32.576488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:32.586073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:32.586073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:32.586073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:32.586073 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:32.586639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:32.586639 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:32.654222 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:32.662323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-81ab9fae-da1f-4b9e-97bf-1e436108ac69 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1200 microversion: 2.1 time: 0.090620 Sep 16 04:01:32.663006 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 569/1138] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:32 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:33.686084 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:33.687400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:33.694250 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:33.694739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:33.696891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:33.696891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:33.696891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:33.696891 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:33.850657 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:33.858768 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4daf9821-ddf3-4642-8257-9de5aa55c698 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1278 microversion: 2.1 time: 0.176594 Sep 16 04:01:33.860003 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 570/1139] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:33 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:34.217913 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-9823283b-d041-4cd8-94cb-1dbe8972fbf1 req-63000c26-449f-4590-afd0-cbeb7ee70a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7847533d-4da5-4e33-b0e0-9b928be023ff", "tag": "6fc17f92-3fb2-40e0-adad-0a715e483426"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:01:34.228810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9823283b-d041-4cd8-94cb-1dbe8972fbf1 req-63000c26-449f-4590-afd0-cbeb7ee70a03 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:34.229317 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9823283b-d041-4cd8-94cb-1dbe8972fbf1 req-63000c26-449f-4590-afd0-cbeb7ee70a03 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:34.229783 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9823283b-d041-4cd8-94cb-1dbe8972fbf1 req-63000c26-449f-4590-afd0-cbeb7ee70a03 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:34.241342 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-9823283b-d041-4cd8-94cb-1dbe8972fbf1 req-63000c26-449f-4590-afd0-cbeb7ee70a03 service nova] Creating event network-changed:6fc17f92-3fb2-40e0-adad-0a715e483426 for instance 7847533d-4da5-4e33-b0e0-9b928be023ff on hv-cinder-85799 Sep 16 04:01:34.246269 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-9823283b-d041-4cd8-94cb-1dbe8972fbf1 req-63000c26-449f-4590-afd0-cbeb7ee70a03 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Sep 16 04:01:34.246859 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 570/1140] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:01:34.883210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:34.883818 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:34.890644 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:34.891266 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:34.891705 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:34.892389 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:34.892838 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:34.893262 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:35.036840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:35.044621 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e665f376-4e47-4f22-9351-cb8c5d221105 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.165302 Sep 16 04:01:35.045216 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 571/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:34 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:36.073071 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:36.073771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:36.080652 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:36.081131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:36.081566 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:36.082254 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:36.082703 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:36.083151 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:36.215314 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:36.224170 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0d63f868-ae68-437a-9fd4-ebd5c9442746 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.155891 Sep 16 04:01:36.224741 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 571/1142] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:36 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:37.246602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:37.247318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:37.258196 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:37.258682 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:37.259165 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:37.259860 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:37.260311 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:37.260739 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:37.389909 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:37.397540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c7dfccbe-c40f-4fa3-8422-a6f33d60abb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.154814 Sep 16 04:01:37.398121 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 572/1143] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:37 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:38.420769 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:38.421380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:38.427908 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:38.428386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:38.428821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:38.429510 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:38.429962 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:38.430393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:38.564843 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:38.572496 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-58c194de-2615-4144-befc-d422592efdd4 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.155637 Sep 16 04:01:38.573056 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 572/1144] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:38 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:39.594482 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:39.595102 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:39.601445 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:39.601919 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:39.602350 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:39.603055 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:39.603501 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:39.603915 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:39.730800 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:39.738818 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0fc02698-463c-4605-a162-7f78479b78cd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.148291 Sep 16 04:01:39.739403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 573/1145] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:39 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:40.762922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:40.763486 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:40.765847 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:01:40.771143 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:40.771626 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:40.772061 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:40.772751 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:40.773201 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:40.773624 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:40.901922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:40.910257 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7bd1d40d-7625-4067-b5d8-fa8342b39832 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.151333 Sep 16 04:01:40.910812 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 573/1146] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:40 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:41.932837 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:41.933470 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:41.935557 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:01:41.936315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:01:41.941935 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:41.942444 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:41.942876 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:41.944237 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:41.944698 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:41.945167 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:42.101263 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:42.109065 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3a5ef925-dfb7-4a34-acec-5cd16f92c1a1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.180141 Sep 16 04:01:42.109628 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 574/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:41 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:43.133440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:43.134025 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:43.140469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:43.140956 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:43.141442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:43.142615 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:43.143499 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:43.144283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:43.283928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:43.294008 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9a54e139-f7ab-4e60-a843-3de10bbcd504 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.164460 Sep 16 04:01:43.294593 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 574/1148] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:43 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:44.318668 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:44.319315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:44.325885 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:44.326373 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:44.326810 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:44.327775 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:44.328231 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:44.329692 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:44.468766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-e6b272c6-996f-44a7-a13e-4c021355bc3b req-784d919f-1ee8-407c-a0aa-238760827be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7847533d-4da5-4e33-b0e0-9b928be023ff", "name": "network-vif-plugged", "status": "completed", "tag": "6fc17f92-3fb2-40e0-adad-0a715e483426"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:01:44.470221 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:44.478534 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ac34cef0-d8e8-46a3-bb8f-d8722ae5994b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.163611 Sep 16 04:01:44.479922 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e6b272c6-996f-44a7-a13e-4c021355bc3b req-784d919f-1ee8-407c-a0aa-238760827be9 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:44.485985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e6b272c6-996f-44a7-a13e-4c021355bc3b req-784d919f-1ee8-407c-a0aa-238760827be9 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:44.485985 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e6b272c6-996f-44a7-a13e-4c021355bc3b req-784d919f-1ee8-407c-a0aa-238760827be9 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:44.488505 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 575/1149] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:44 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:44.577400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-e6b272c6-996f-44a7-a13e-4c021355bc3b req-784d919f-1ee8-407c-a0aa-238760827be9 service nova] Creating event network-vif-plugged:6fc17f92-3fb2-40e0-adad-0a715e483426 for instance 7847533d-4da5-4e33-b0e0-9b928be023ff on hv-cinder-85799 Sep 16 04:01:44.577400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-e6b272c6-996f-44a7-a13e-4c021355bc3b req-784d919f-1ee8-407c-a0aa-238760827be9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101257 Sep 16 04:01:44.577400 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 575/1150] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 04:01:45.502038 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:45.502683 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:45.509132 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:45.509615 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:45.510051 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:45.510737 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:45.511214 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:45.511637 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:45.641032 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:45.649750 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-32e7c711-43c6-45c3-850e-4afa00e2842f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1266 microversion: 2.1 time: 0.151925 Sep 16 04:01:45.650322 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 576/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:45 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:46.674998 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:46.675698 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:46.682294 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:46.682771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:46.683223 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:46.683910 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:46.684352 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:46.684766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:46.823651 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:46.831866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8096ad26-1740-4418-a019-6265bbc96fca tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1454 microversion: 2.1 time: 0.161969 Sep 16 04:01:46.832427 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 576/1152] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:46 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:46.854346 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:01:46.854975 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:01:46.861294 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:46.861763 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:46.862190 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:46.862865 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:46.863335 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:46.863752 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:46.993405 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:01:47.001122 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7a61d82c-ecae-4751-b421-f0db20b5c1a9 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1454 microversion: 2.1 time: 0.150603 Sep 16 04:01:47.001686 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 577/1153] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:01:46 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:01:49.106568 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-7698f481-3484-4d90-856c-2145ad7e873e req-ddbdc1f9-0c49-4ab1-8803-614a819e139c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7847533d-4da5-4e33-b0e0-9b928be023ff", "tag": "6fc17f92-3fb2-40e0-adad-0a715e483426"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:01:49.116941 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7698f481-3484-4d90-856c-2145ad7e873e req-ddbdc1f9-0c49-4ab1-8803-614a819e139c service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:01:49.117419 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7698f481-3484-4d90-856c-2145ad7e873e req-ddbdc1f9-0c49-4ab1-8803-614a819e139c service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:01:49.117850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7698f481-3484-4d90-856c-2145ad7e873e req-ddbdc1f9-0c49-4ab1-8803-614a819e139c service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:01:49.129754 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-7698f481-3484-4d90-856c-2145ad7e873e req-ddbdc1f9-0c49-4ab1-8803-614a819e139c service nova] Creating event network-changed:6fc17f92-3fb2-40e0-adad-0a715e483426 for instance 7847533d-4da5-4e33-b0e0-9b928be023ff on hv-cinder-85799 Sep 16 04:01:49.134937 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-7698f481-3484-4d90-856c-2145ad7e873e req-ddbdc1f9-0c49-4ab1-8803-614a819e139c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032118 Sep 16 04:01:49.135534 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 577/1154] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:03:35.854081 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR oslo.messaging._drivers.impl_rabbit [-] [25dba2fb-ae43-4d7d-8489-e60d309cc698] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 04:03:35.855900 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:03:35.856694 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:03:35.861734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-847675224", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-106478167", "security_groups": [{"name": "tempest-secgroup-smoke-1031301844"}], "block_device_mapping_v2": [{"uuid": "404db24d-2304-400f-bcb8-2c1db5fcd4c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6fd8153b-b435-473d-99b3-693648eee8c9"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:03:36.069093 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] validate_networks() for [('6fd8153b-b435-473d-99b3-693648eee8c9', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 04:03:36.430420 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 04:03:36.430839 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 04:03:36.431408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 04:03:36.431824 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 04:03:36.432232 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 04:03:36.441505 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:36.441976 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:36.442403 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:36.443150 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:36.443598 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:36.444013 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:36.460801 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Getting quotas for project 42406ac5a18945dea55e37a91e9f5530. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 04:03:36.464566 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Getting quotas for user d8b2c15cd31544069f0888a04bfe0c63 and project 42406ac5a18945dea55e37a91e9f5530. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 04:03:36.520626 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 04:03:36.522665 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='404db24d-2304-400f-bcb8-2c1db5fcd4c0',volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 04:03:36.888699 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] [25dba2fb-ae43-4d7d-8489-e60d309cc698] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 55808. Sep 16 04:03:36.973210 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-42880a87-78ff-49c7-be31-cfbb1757faf3 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.121537 Sep 16 04:03:36.973854 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 578/1155] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 16 04:03:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 04:03:36.983820 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=30 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:03:36.984687 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=62 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:03:36.985864 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 04:03:36.986069 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Fri Sep 16 04:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb (ip 10.222.0.49) !!! Sep 16 04:03:36.991226 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6b1917fd-eec8-4227-b848-229d250b3b13 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:36.992020 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6b1917fd-eec8-4227-b848-229d250b3b13 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:37.111289 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6b1917fd-eec8-4227-b848-229d250b3b13 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:37.118249 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6b1917fd-eec8-4227-b848-229d250b3b13 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1093 microversion: 2.1 time: 0.136426 Sep 16 04:03:37.118889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 578/1156] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:36 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1093 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:38.142037 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:38.142649 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:38.149537 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:38.150019 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:38.150454 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:38.151185 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:38.151850 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:38.152465 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:38.215807 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:38.223989 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-50b90a1d-8f8d-4380-8389-412794f83817 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1191 microversion: 2.1 time: 0.086535 Sep 16 04:03:38.224617 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 579/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:38 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:39.247753 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:39.248818 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:39.257398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:39.257886 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:39.258320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:39.259737 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:39.260254 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:39.260705 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:39.332445 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:39.340837 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-66d0302c-d6db-4cc3-87c1-b5bfd80aa939 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1209 microversion: 2.1 time: 0.097728 Sep 16 04:03:39.341517 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 579/1158] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:39 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 04:03:40.365862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:40.366505 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:40.374474 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:40.375315 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:40.375809 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:40.376528 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:40.376987 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:40.377407 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:40.706399 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:40.714690 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ed3cd11f-ca89-4a15-b033-21caba53e99a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.352247 Sep 16 04:03:40.715300 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 580/1159] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:40 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:40.864451 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-6c0fa021-feb6-4341-9573-6201cab50e36 req-89add626-15e7-4205-81bf-19bd9e88b46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161af4a9-1807-4873-9e5d-2e9360857eeb", "tag": "b4b3c48c-bf8e-42d4-91d3-d747c9e29312"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:03:40.876011 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6c0fa021-feb6-4341-9573-6201cab50e36 req-89add626-15e7-4205-81bf-19bd9e88b46f service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:40.879707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6c0fa021-feb6-4341-9573-6201cab50e36 req-89add626-15e7-4205-81bf-19bd9e88b46f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:40.879707 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6c0fa021-feb6-4341-9573-6201cab50e36 req-89add626-15e7-4205-81bf-19bd9e88b46f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:40.888750 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-6c0fa021-feb6-4341-9573-6201cab50e36 req-89add626-15e7-4205-81bf-19bd9e88b46f service nova] Creating event network-changed:b4b3c48c-bf8e-42d4-91d3-d747c9e29312 for instance 161af4a9-1807-4873-9e5d-2e9360857eeb on hv-cinder-85799 Sep 16 04:03:40.894051 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-6c0fa021-feb6-4341-9573-6201cab50e36 req-89add626-15e7-4205-81bf-19bd9e88b46f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Sep 16 04:03:40.894648 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 580/1160] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:03:41.738075 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:41.738710 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:41.745631 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:41.746119 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:41.746552 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:41.747264 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:41.747720 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:41.748174 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:41.875745 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:41.883359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-819d06d0-6929-4390-9c40-5292eb58f642 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.149248 Sep 16 04:03:41.883924 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 581/1161] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:41 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:42.906895 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:42.907607 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:42.914264 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:42.914734 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:42.915192 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:42.915869 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:42.916312 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:42.916725 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:43.045310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:43.052977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b1f0567b-102e-4f3e-afa8-0702600760bf tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.150332 Sep 16 04:03:43.053534 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 581/1162] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:42 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:44.077490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:44.078115 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:44.084864 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:44.085353 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:44.085792 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:44.086486 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:44.086955 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:44.087374 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:44.243540 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:44.253732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-342ab6cd-f795-4c48-8c46-a7cb1482fe3a tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.179762 Sep 16 04:03:44.254318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 582/1163] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:44 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:45.277291 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:45.277915 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:45.284319 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:45.284799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:45.285237 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:45.285928 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:45.286381 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:45.286808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:45.420490 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:45.428092 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b8220c8d-47e1-474c-bcd8-1edb00728424 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.154701 Sep 16 04:03:45.428645 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 582/1164] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:45 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:46.451432 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:46.452040 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:46.454286 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:03:46.459186 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:46.464368 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:46.464368 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:46.464368 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:46.464368 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:46.464939 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:46.477415 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:03:46.592849 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:46.600518 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-efb1e2c3-644e-4e6f-9154-5605f2669768 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.153790 Sep 16 04:03:46.601083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 583/1165] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:46 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:47.624520 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:47.625132 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:47.627620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:03:47.632320 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:47.632799 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:47.633225 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:47.633901 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:47.634344 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:47.634762 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:47.768334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:47.776097 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1c8028b7-8b0e-4ae4-8188-ae2b2c62a4d8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.155981 Sep 16 04:03:47.781469 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 583/1166] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:47 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:48.798985 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:48.799599 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:48.805880 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:48.809966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:48.809966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:48.809966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:48.809966 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:48.810408 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:48.943239 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:48.951620 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0b3620b1-f13a-47fb-959e-3e206c762ccd tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.156533 Sep 16 04:03:48.952490 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 584/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:48 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:49.975349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:49.975959 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:49.982358 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:49.982821 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:49.983277 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:49.983958 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:49.984403 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:49.984827 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:50.114470 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:50.122808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a414299f-d01b-404e-b040-b3a479f3516f tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.151313 Sep 16 04:03:50.123386 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 584/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:49 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:51.035536 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-6391c43a-15cf-4772-a74d-2fccb127cdba req-4050038d-a5c6-4151-b48b-e2abc2605c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161af4a9-1807-4873-9e5d-2e9360857eeb", "name": "network-vif-plugged", "status": "completed", "tag": "b4b3c48c-bf8e-42d4-91d3-d747c9e29312"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:03:51.046385 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-6391c43a-15cf-4772-a74d-2fccb127cdba req-4050038d-a5c6-4151-b48b-e2abc2605c0f service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:51.046862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-6391c43a-15cf-4772-a74d-2fccb127cdba req-4050038d-a5c6-4151-b48b-e2abc2605c0f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:51.047318 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-6391c43a-15cf-4772-a74d-2fccb127cdba req-4050038d-a5c6-4151-b48b-e2abc2605c0f service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:51.057969 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-6391c43a-15cf-4772-a74d-2fccb127cdba req-4050038d-a5c6-4151-b48b-e2abc2605c0f service nova] Creating event network-vif-plugged:b4b3c48c-bf8e-42d4-91d3-d747c9e29312 for instance 161af4a9-1807-4873-9e5d-2e9360857eeb on hv-cinder-85799 Sep 16 04:03:51.062123 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR oslo.messaging._drivers.impl_rabbit [req-6391c43a-15cf-4772-a74d-2fccb127cdba req-4050038d-a5c6-4151-b48b-e2abc2605c0f service nova] [38086d35-1323-4868-831f-361a92324e83] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 04:03:51.145829 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:51.146442 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:51.153230 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:51.153711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:51.154169 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:51.154857 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:51.155349 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:51.155768 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:51.288189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:51.296263 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e2342c77-309d-4f79-8fd9-81ecabe95082 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.154305 Sep 16 04:03:51.296866 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 585/1169] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:51 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 04:03:52.069005 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [req-6391c43a-15cf-4772-a74d-2fccb127cdba req-4050038d-a5c6-4151-b48b-e2abc2605c0f service nova] [38086d35-1323-4868-831f-361a92324e83] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 55858. Sep 16 04:03:52.072297 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-6391c43a-15cf-4772-a74d-2fccb127cdba req-4050038d-a5c6-4151-b48b-e2abc2605c0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040648 Sep 16 04:03:52.072900 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 585/1170] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:03:52.319912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:52.320488 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:52.326953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:52.327435 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:52.327891 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:52.328576 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:52.329271 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:52.329529 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:52.466731 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:52.474175 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ec0fdea4-ae08-4bcf-92e5-c537eabd136d tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.158615 Sep 16 04:03:52.474756 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 586/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:52 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:53.499491 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:53.500110 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:53.506205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:53.506684 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:53.507161 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:53.507840 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:53.508289 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:53.508714 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:53.641851 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:53.649663 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-90197c42-2d4d-4479-bf8f-5b1131110026 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1265 microversion: 2.1 time: 0.155697 Sep 16 04:03:53.650232 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 586/1172] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:53 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:54.673841 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:54.674422 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:54.680856 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:54.682332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:54.682332 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:54.682559 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:54.682898 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:54.683334 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:54.832808 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:54.842235 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-65b1fe0d-9295-4da5-8bee-29f9bbb24077 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1452 microversion: 2.1 time: 0.172537 Sep 16 04:03:54.842802 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 587/1173] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:54 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:54.863854 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:03:54.864468 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:03:54.870871 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:54.871390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:54.871858 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:54.872542 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:54.872994 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:54.873418 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:55.005150 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:03:55.013478 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-49632526-d809-40e9-8a56-6a99e28fb700 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1452 microversion: 2.1 time: 0.153417 Sep 16 04:03:55.014034 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 587/1174] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:03:54 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:03:56.951188 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-da7b31e1-7b73-4d67-9b54-ac337b58e355 req-fc84a90c-d2db-4296-a16f-73d8ffeb893d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161af4a9-1807-4873-9e5d-2e9360857eeb", "tag": "b4b3c48c-bf8e-42d4-91d3-d747c9e29312"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:03:56.960556 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-da7b31e1-7b73-4d67-9b54-ac337b58e355 req-fc84a90c-d2db-4296-a16f-73d8ffeb893d service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:03:56.961037 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-da7b31e1-7b73-4d67-9b54-ac337b58e355 req-fc84a90c-d2db-4296-a16f-73d8ffeb893d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:03:56.961467 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-da7b31e1-7b73-4d67-9b54-ac337b58e355 req-fc84a90c-d2db-4296-a16f-73d8ffeb893d service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:03:56.973261 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-da7b31e1-7b73-4d67-9b54-ac337b58e355 req-fc84a90c-d2db-4296-a16f-73d8ffeb893d service nova] Creating event network-changed:b4b3c48c-bf8e-42d4-91d3-d747c9e29312 for instance 161af4a9-1807-4873-9e5d-2e9360857eeb on hv-cinder-85799 Sep 16 04:03:56.978351 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-da7b31e1-7b73-4d67-9b54-ac337b58e355 req-fc84a90c-d2db-4296-a16f-73d8ffeb893d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084633 Sep 16 04:03:56.978960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 588/1175] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:05:25.292625 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=24 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:05:25.293372 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=52 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:05:25.295688 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:05:25.298744 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=52 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:05:25.298744 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 04:05:25.298744 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Fri Sep 16 04:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb (ip 10.222.0.49) !!! Sep 16 04:05:25.304018 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 04:05:25.304844 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Fri Sep 16 04:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.49) !!! Sep 16 04:05:25.309630 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:25.310368 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-59510e0d-e462-44c7-a67d-3004fe8d82ba req-a08cdace-a24a-4309-92a7-8d0e8b6de8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161af4a9-1807-4873-9e5d-2e9360857eeb", "tag": "b4b3c48c-bf8e-42d4-91d3-d747c9e29312"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:05:25.310960 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:25.318679 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:25.319890 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:25.320602 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:25.321780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:25.322347 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:25.322577 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-59510e0d-e462-44c7-a67d-3004fe8d82ba req-a08cdace-a24a-4309-92a7-8d0e8b6de8c8 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:25.322884 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:25.323142 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-59510e0d-e462-44c7-a67d-3004fe8d82ba req-a08cdace-a24a-4309-92a7-8d0e8b6de8c8 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:25.327530 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-59510e0d-e462-44c7-a67d-3004fe8d82ba req-a08cdace-a24a-4309-92a7-8d0e8b6de8c8 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:25.337624 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-59510e0d-e462-44c7-a67d-3004fe8d82ba req-a08cdace-a24a-4309-92a7-8d0e8b6de8c8 service nova] Creating event network-changed:b4b3c48c-bf8e-42d4-91d3-d747c9e29312 for instance 161af4a9-1807-4873-9e5d-2e9360857eeb on hv-cinder-85799 Sep 16 04:05:25.343440 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-59510e0d-e462-44c7-a67d-3004fe8d82ba req-a08cdace-a24a-4309-92a7-8d0e8b6de8c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052593 Sep 16 04:05:25.344425 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 589/1176] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:05:25.355149 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 04:05:25.667732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-455fe638-c53b-4f05-ab47-c1f7996f04ab tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "DELETE /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 204 len: 0 microversion: 2.1 time: 0.380333 Sep 16 04:05:25.668389 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 588/1177] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 04:05:25 2022] DELETE /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 04:05:25.677457 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:25.678092 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:25.685839 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:25.686323 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:25.687186 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:25.688680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:25.689310 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:25.689912 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:25.848907 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:05:25.858188 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-240ee93f-0b81-4883-869d-f82eda60c791 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1577 microversion: 2.1 time: 0.184892 Sep 16 04:05:25.860336 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 590/1178] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:25 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 04:05:26.882202 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:26.882889 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:26.889310 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:26.889786 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:26.890213 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:26.890892 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:26.891358 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:26.891774 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:27.092548 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:05:27.100326 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1f6c4741-b7b3-42c5-a887-18d274df5eb8 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1577 microversion: 2.1 time: 0.222301 Sep 16 04:05:27.101172 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:26 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:05:28.073339 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-8f725133-e2d9-4720-9f71-67ae790383e6 req-9fd396f8-1315-4d05-a599-0c440fb8afce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161af4a9-1807-4873-9e5d-2e9360857eeb", "name": "network-vif-deleted", "tag": "b4b3c48c-bf8e-42d4-91d3-d747c9e29312"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:05:28.083139 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8f725133-e2d9-4720-9f71-67ae790383e6 req-9fd396f8-1315-4d05-a599-0c440fb8afce service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:28.083699 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8f725133-e2d9-4720-9f71-67ae790383e6 req-9fd396f8-1315-4d05-a599-0c440fb8afce service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:28.084208 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8f725133-e2d9-4720-9f71-67ae790383e6 req-9fd396f8-1315-4d05-a599-0c440fb8afce service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:28.096481 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-8f725133-e2d9-4720-9f71-67ae790383e6 req-9fd396f8-1315-4d05-a599-0c440fb8afce service nova] Creating event network-vif-deleted:b4b3c48c-bf8e-42d4-91d3-d747c9e29312 for instance 161af4a9-1807-4873-9e5d-2e9360857eeb on hv-cinder-85799 Sep 16 04:05:28.102072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-8f725133-e2d9-4720-9f71-67ae790383e6 req-9fd396f8-1315-4d05-a599-0c440fb8afce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112679 Sep 16 04:05:28.102662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 591/1180] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:05:28.125182 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:28.125801 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:28.132247 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:28.132732 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:28.133168 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:28.133853 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:28.134304 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:28.134734 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:28.198825 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:05:28.206681 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0443747e-c41f-4259-b0bc-4cd19c95e307 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1390 microversion: 2.1 time: 0.085352 Sep 16 04:05:28.207597 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 590/1181] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:28 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:05:29.231700 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:29.232403 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:29.238595 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:29.239120 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:29.239556 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:29.240242 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:29.240689 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:29.241111 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:29.273413 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:29.273889 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:29.274322 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:29.274771 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lazy-loading 'fault' on Instance uuid 161af4a9-1807-4873-9e5d-2e9360857eeb {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 04:05:29.317131 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:05:29.325398 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-17fe5b7f-0fe8-4a13-812f-00c58e20b36b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 200 len: 1229 microversion: 2.1 time: 0.098542 Sep 16 04:05:29.325953 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 592/1182] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:29 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:05:30.348609 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:30.349222 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 161af4a9-1807-4873-9e5d-2e9360857eeb] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:30.355844 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:30.356322 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:30.356749 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:30.357435 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:30.357879 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:30.358294 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:30.371636 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] HTTP exception thrown: Instance 161af4a9-1807-4873-9e5d-2e9360857eeb could not be found. Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Request method failure captured: Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb HTTP/1.1 Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_RnaFGj5sxjdCRB0-CGl_ea4BmCjcBEvRsvLsORyxPLB-LseH3r38yfCZU4ILNw2nggAwrRsIiMT5gn4psFbhd0r6HWqKoJnH2-2guaTvKAuEXp3stva-O4WIodpOLWTR6XUixrRR7Y__rSnOqS7FyuxxlzLIEe35619Elj76TwH4c Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 04:05:30.373281 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}] Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: d8b2c15cd31544069f0888a04bfe0c63 Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 161af4a9-1807-4873-9e5d-2e9360857eeb could not be found. Sep 16 04:05:30.375178 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '161af4a9-1807-4873-9e5d-2e9360857eeb'} Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161af4a9-1807-4873-9e5d-2e9360857eeb could not be found. Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 04:05:30.376198 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161af4a9-1807-4873-9e5d-2e9360857eeb could not be found. Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161af4a9-1807-4873-9e5d-2e9360857eeb could not be found. Sep 16 04:05:30.378072 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:30.379715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Returning 404 to user: Instance 161af4a9-1807-4873-9e5d-2e9360857eeb could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 04:05:30.379715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-83b3b605-594f-422c-8209-ca5f4ccbd59b tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb" status: 404 len: 111 microversion: 2.1 time: 0.030033 Sep 16 04:05:30.379715 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 591/1183] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:30 2022] GET /compute/v2.1/servers/161af4a9-1807-4873-9e5d-2e9360857eeb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 04:05:33.761536 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-bca8d8bb-ab73-4093-a629-e3bfe8f7e896 req-47a4b4fb-dd6f-4461-b6fc-7ee06751df30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7847533d-4da5-4e33-b0e0-9b928be023ff", "tag": "6fc17f92-3fb2-40e0-adad-0a715e483426"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:05:33.768404 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:33.768977 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:33.773112 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bca8d8bb-ab73-4093-a629-e3bfe8f7e896 req-47a4b4fb-dd6f-4461-b6fc-7ee06751df30 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:33.774308 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bca8d8bb-ab73-4093-a629-e3bfe8f7e896 req-47a4b4fb-dd6f-4461-b6fc-7ee06751df30 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:33.775440 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bca8d8bb-ab73-4093-a629-e3bfe8f7e896 req-47a4b4fb-dd6f-4461-b6fc-7ee06751df30 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:33.776146 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:33.776635 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:33.777072 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:33.777766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:33.778595 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:33.779045 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:33.791151 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-bca8d8bb-ab73-4093-a629-e3bfe8f7e896 req-47a4b4fb-dd6f-4461-b6fc-7ee06751df30 service nova] Creating event network-changed:6fc17f92-3fb2-40e0-adad-0a715e483426 for instance 7847533d-4da5-4e33-b0e0-9b928be023ff on hv-cinder-85799 Sep 16 04:05:33.796862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-bca8d8bb-ab73-4093-a629-e3bfe8f7e896 req-47a4b4fb-dd6f-4461-b6fc-7ee06751df30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038939 Sep 16 04:05:33.797793 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 592/1184] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:05:33.810212 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 04:05:34.149444 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6b8979ad-f56f-4287-8e0e-90bce22dc842 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 204 len: 0 microversion: 2.1 time: 0.393542 Sep 16 04:05:34.151643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 593/1185] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 04:05:33 2022] DELETE /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 04:05:34.165704 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:34.166727 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:34.172908 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:34.173390 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:34.173831 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:34.174529 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:34.175015 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:34.175436 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:34.333156 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:05:34.341241 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-43a28b5f-5785-476a-85c4-b897c4a54a42 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1578 microversion: 2.1 time: 0.180445 Sep 16 04:05:34.341842 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 593/1186] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:34 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:05:35.365003 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:35.365711 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:35.372325 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:35.372810 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:35.373245 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:35.373942 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:35.374383 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:35.374806 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:35.507850 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:05:35.516040 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c5fa67e5-443e-4b7e-aef8-6fe62e2a625c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1578 microversion: 2.1 time: 0.155327 Sep 16 04:05:35.516662 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 594/1187] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:35 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:05:36.445780 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-b10b2a63-84bb-4713-bd3d-2f9b0cb08a41 req-1070bbe4-b66c-47f4-9e76-1dabad4834a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7847533d-4da5-4e33-b0e0-9b928be023ff", "name": "network-vif-deleted", "tag": "6fc17f92-3fb2-40e0-adad-0a715e483426"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 04:05:36.459862 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b10b2a63-84bb-4713-bd3d-2f9b0cb08a41 req-1070bbe4-b66c-47f4-9e76-1dabad4834a8 service nova] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:36.461083 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b10b2a63-84bb-4713-bd3d-2f9b0cb08a41 req-1070bbe4-b66c-47f4-9e76-1dabad4834a8 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:36.461619 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b10b2a63-84bb-4713-bd3d-2f9b0cb08a41 req-1070bbe4-b66c-47f4-9e76-1dabad4834a8 service nova] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:36.472756 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-b10b2a63-84bb-4713-bd3d-2f9b0cb08a41 req-1070bbe4-b66c-47f4-9e76-1dabad4834a8 service nova] Creating event network-vif-deleted:6fc17f92-3fb2-40e0-adad-0a715e483426 for instance 7847533d-4da5-4e33-b0e0-9b928be023ff on hv-cinder-85799 Sep 16 04:05:36.478359 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-b10b2a63-84bb-4713-bd3d-2f9b0cb08a41 req-1070bbe4-b66c-47f4-9e76-1dabad4834a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036490 Sep 16 04:05:36.479014 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 594/1188] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 16 04:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 04:05:36.542283 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:36.543620 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:36.550113 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:36.550643 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:36.551106 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:36.551796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:36.552239 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:36.552766 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:36.619932 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:05:36.627974 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ab4342b5-2f76-4916-8d0d-955e46e7ca9c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1392 microversion: 2.1 time: 0.090292 Sep 16 04:05:36.628535 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 595/1189] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:36 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1392 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:05:37.652573 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:37.653291 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:37.659425 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:37.659948 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:37.660503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:37.661187 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:37.661638 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:37.662062 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:37.692345 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:37.693124 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:37.693557 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:37.693996 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lazy-loading 'fault' on Instance uuid 7847533d-4da5-4e33-b0e0-9b928be023ff {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 04:05:37.739291 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b2c15cd31544069f0888a04bfe0c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42406ac5a18945dea55e37a91e9f5530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 04:05:37.748041 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9da5eb4e-4672-4f8a-aee1-6fe4d82e9382 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 200 len: 1230 microversion: 2.1 time: 0.101142 Sep 16 04:05:37.748613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 595/1190] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:37 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 04:05:38.777380 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:38.777992 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 7847533d-4da5-4e33-b0e0-9b928be023ff] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:38.784517 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:38.784989 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:38.785414 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:38.786119 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:38.786563 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:38.787011 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:38.801189 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] HTTP exception thrown: Instance 7847533d-4da5-4e33-b0e0-9b928be023ff could not be found. Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Request method failure captured: Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff HTTP/1.1 Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_RnaFGj5sxjdCRB0-CGl_ea4BmCjcBEvRsvLsORyxPLB-LseH3r38yfCZU4ILNw2nggAwrRsIiMT5gn4psFbhd0r6HWqKoJnH2-2guaTvKAuEXp3stva-O4WIodpOLWTR6XUixrRR7Y__rSnOqS7FyuxxlzLIEe35619Elj76TwH4c Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 04:05:38.802933 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}] Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: d8b2c15cd31544069f0888a04bfe0c63 Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 7847533d-4da5-4e33-b0e0-9b928be023ff could not be found. Sep 16 04:05:38.804845 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '7847533d-4da5-4e33-b0e0-9b928be023ff'} Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7847533d-4da5-4e33-b0e0-9b928be023ff could not be found. Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 04:05:38.805863 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7847533d-4da5-4e33-b0e0-9b928be023ff could not be found. Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7847533d-4da5-4e33-b0e0-9b928be023ff could not be found. Sep 16 04:05:38.807555 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:38.809255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Returning 404 to user: Instance 7847533d-4da5-4e33-b0e0-9b928be023ff could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 04:05:38.809255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-23a84d32-0ed9-4091-b8c6-36e56ae21cc5 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff" status: 404 len: 111 microversion: 2.1 time: 0.031760 Sep 16 04:05:38.809255 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 596/1191] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:38 2022] GET /compute/v2.1/servers/7847533d-4da5-4e33-b0e0-9b928be023ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 04:05:39.342048 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:39.342541 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:39.348926 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:39.349400 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:39.349829 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:39.350550 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:39.351094 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:39.351503 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:39.367140 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] HTTP exception thrown: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Request method failure captured: Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 HTTP/1.1 Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.49 Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjI_RnaFGj5sxjdCRB0-CGl_ea4BmCjcBEvRsvLsORyxPLB-LseH3r38yfCZU4ILNw2nggAwrRsIiMT5gn4psFbhd0r6HWqKoJnH2-2guaTvKAuEXp3stva-O4WIodpOLWTR6XUixrRR7Y__rSnOqS7FyuxxlzLIEe35619Elj76TwH4c Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 16 04:05:39.368785 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}] Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Id: d8b2c15cd31544069f0888a04bfe0c63 Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: method: > Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: exception: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.370613 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '08c29179-15b1-4f96-89b5-3cede4ba5a26'} Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 04:05:39.371706 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.373376 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.375205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Returning 404 to user: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 04:05:39.375205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-374d517c-2347-4191-8b84-b111dfced3f1 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "DELETE /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 404 len: 111 microversion: 2.1 time: 0.032011 Sep 16 04:05:39.375205 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 596/1192] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 16 04:05:39 2022] DELETE /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 04:05:39.378680 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:39.379434 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] [instance: 08c29179-15b1-4f96-89b5-3cede4ba5a26] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 04:05:39.386156 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:39.386658 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:39.387121 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:39.387796 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Acquiring lock "035a2354-99fe-448b-a23d-f019d795a350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 04:05:39.388247 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 04:05:39.388660 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Lock "035a2354-99fe-448b-a23d-f019d795a350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 04:05:39.402393 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] HTTP exception thrown: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Request method failure captured: Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 HTTP/1.1 Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.49 Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjI_RnaFGj5sxjdCRB0-CGl_ea4BmCjcBEvRsvLsORyxPLB-LseH3r38yfCZU4ILNw2nggAwrRsIiMT5gn4psFbhd0r6HWqKoJnH2-2guaTvKAuEXp3stva-O4WIodpOLWTR6XUixrRR7Y__rSnOqS7FyuxxlzLIEe35619Elj76TwH4c Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 16 04:05:39.404217 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/42406ac5a18945dea55e37a91e9f5530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/42406ac5a18945dea55e37a91e9f5530"}]}] Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 42406ac5a18945dea55e37a91e9f5530 Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134200195 Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Id: d8b2c15cd31544069f0888a04bfe0c63 Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-2134200195-project Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: method: > Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: exception: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.405960 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '08c29179-15b1-4f96-89b5-3cede4ba5a26'} Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 04:05:39.406988 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. Sep 16 04:05:39.408695 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 16 04:05:39.410231 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Returning 404 to user: Instance 08c29179-15b1-4f96-89b5-3cede4ba5a26 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 04:05:39.410231 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c4ac2a0e-009c-452f-8842-198231618697 tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26" status: 404 len: 111 microversion: 2.1 time: 0.030972 Sep 16 04:05:39.410231 dv-cinder-857993-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 597/1193] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 16 04:05:39 2022] GET /compute/v2.1/servers/08c29179-15b1-4f96-89b5-3cede4ba5a26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 04:05:40.912882 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-06fb9443-ff14-415f-ab88-23865eb5c36c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] Calling method '.version_select at 0x7fba7cae0f70>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 04:05:40.984136 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-06fb9443-ff14-415f-ab88-23865eb5c36c tempest-TestVolumeBootPattern-2134200195 tempest-TestVolumeBootPattern-2134200195-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-106478167" status: 202 len: 0 microversion: 2.1 time: 0.074996 Sep 16 04:05:40.984747 dv-cinder-857993-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 597/1194] 10.222.0.49 () {58 vars in 1260 bytes} [Fri Sep 16 04:05:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-106478167 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)